-- Logs begin at Tue 2022-06-21 09:51:00 UTC, end at Tue 2022-06-21 11:03:55 UTC. -- Jun 21 10:26:43.792394 dv-cinder-836973-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 10:26:43.802263 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 10:26:43 2022] *** Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: nodename: dv-cinder-836973-8-iscsi Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: machine: x86_64 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: clock source: unix Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: pcre jit disabled Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: detected number of CPU cores: 4 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: current working directory: / Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: detected binary path: /usr/bin/uwsgi-core Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: your processes number limit is 47680 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: your memory page size is 4096 bytes Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: detected max file descriptor number: 2048 Jun 21 10:26:43.804230 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: lock engine: pthread robust mutexes Jun 21 10:26:43.805015 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: thunder lock: enabled Jun 21 10:26:43.805015 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 10:26:43.805015 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 10:26:43.848024 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: Python main interpreter initialized at 0x557ff02379c0 Jun 21 10:26:43.848024 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: python threads support enabled Jun 21 10:26:43.848024 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: your server socket listen backlog is limited to 100 connections Jun 21 10:26:43.848024 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: your mercy for graceful operations on workers is 90 seconds Jun 21 10:26:43.848385 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 10:26:43.848475 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: *** Operational MODE: preforking *** Jun 21 10:26:43.848699 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: *** uWSGI is running in multiple interpreter mode *** Jun 21 10:26:43.848699 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: spawned uWSGI master process (pid: 103345) Jun 21 10:26:43.851435 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: spawned uWSGI worker 1 (pid: 103346, cores: 1) Jun 21 10:26:43.851435 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: spawned uWSGI worker 2 (pid: 103347, cores: 1) Jun 21 10:26:43.851435 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 10:26:43.848917 dv-cinder-836973-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 10:26:44.521258 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 10:26:44.528904 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 10:26:45.667756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:26:45.667756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: from cryptography.utils import int_from_bytes Jun 21 10:26:45.668450 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:26:45.668450 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: from cryptography.utils import int_from_bytes Jun 21 10:26:45.692863 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:26:45.692863 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: from cryptography.utils import int_from_bytes Jun 21 10:26:45.693488 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:26:45.693488 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: from cryptography.utils import int_from_bytes Jun 21 10:26:48.124045 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:26:48.124651 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:26:48.124754 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:26:48.124754 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:26:48.125148 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:26:48.125228 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:26:48.125305 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:26:48.125504 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:26:48.126249 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:26:48.126351 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.126430 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:26:48.126517 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.126586 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.126649 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.126949 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127089 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127244 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127332 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127580 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127725 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127869 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.127956 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128226 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128365 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128516 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128629 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128816 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.128959 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129127 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129256 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129419 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129574 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-8-iscsi {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129711 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.129850 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130082 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130218 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-8-iscsi {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130373 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130461 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130696 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130803 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.130985 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131078 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131303 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131395 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131603 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131692 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.131926 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.132101 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.132204 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.132558 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.132711 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.132842 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133030 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133142 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133334 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133455 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133643 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133794 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.133982 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134130 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134317 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134416 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134624 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134720 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.134947 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135041 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135254 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135349 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135577 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135711 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-8-iscsi {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135890 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.135987 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.136283 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.136364 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-8-iscsi {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.136597 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.136688 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.136909 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137033 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137222 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137321 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137595 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137677 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.137914 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138040 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138256 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138353 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138561 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138643 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138887 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.138981 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139196 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139280 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139511 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139651 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139833 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.139945 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140136 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140259 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140445 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140536 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140743 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.140849 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141180 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141284 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141446 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141595 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141781 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.141942 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142037 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142497 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142601 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142681 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142770 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.142942 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143045 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143260 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143346 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143606 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.143895 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144071 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144220 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144421 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144563 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144698 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.144783 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145004 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145088 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145310 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145396 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145617 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145711 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.145923 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146004 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146254 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146339 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146560 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146650 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146865 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.146963 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147174 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147260 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147482 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147565 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147787 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.147882 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148092 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148180 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148410 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148500 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148732 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.148828 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149038 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149168 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149342 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149434 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149679 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149772 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.149979 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150116 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150317 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150410 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150632 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150738 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.150955 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151046 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151261 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151353 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151572 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151687 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151870 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.151969 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152180 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152262 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152487 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152573 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152799 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.152884 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153046 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153136 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153346 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153430 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153647 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153732 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.153962 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154046 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154288 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154373 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154590 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154679 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154895 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.154993 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155202 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155286 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155500 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155591 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155800 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.155890 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.156100 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.156189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.156401 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.156549 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.156807 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157347 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157448 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157534 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157612 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157689 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157772 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157859 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.157944 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158167 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158278 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158483 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158600 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158796 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.158908 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159103 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159212 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159425 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159522 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159749 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.159841 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160064 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160163 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160375 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160482 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160685 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160784 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.160993 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161085 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161294 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161411 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161596 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161687 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.161909 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162021 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162244 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162353 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162547 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162631 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162865 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.162948 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163165 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163259 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163472 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163556 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163779 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.163861 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164082 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164172 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164385 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164468 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164686 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164769 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.164989 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165086 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165293 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165378 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165597 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165680 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165896 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.165980 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166224 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166323 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166524 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166607 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166828 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.166918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167134 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167218 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167440 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167526 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167741 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.167825 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168041 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168122 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168359 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168442 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168666 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.168749 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.168985 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.169069 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.169285 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.169381 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.169604 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:26:48.169689 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.169944 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170034 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170301 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170408 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170620 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170705 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.170944 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171028 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171258 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171352 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171585 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171668 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.171901 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.172002 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.172264 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.172414 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.172580 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.172930 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173014 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173186 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173264 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173495 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173577 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173807 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.173913 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174148 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174259 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174468 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174551 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174776 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.174860 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175095 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175182 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175410 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175494 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175729 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.175812 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176041 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176147 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176380 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176464 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176723 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.176807 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177036 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177121 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177360 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177443 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177683 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177767 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.177993 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178120 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178333 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178417 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178643 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178735 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.178964 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179047 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179296 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179387 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179604 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179704 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.179918 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180003 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180228 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180384 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180541 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180634 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180855 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.180938 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181166 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181257 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181477 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181569 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181789 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.181871 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182131 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182241 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182446 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182531 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182757 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.182847 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183076 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183160 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183390 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183475 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183701 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.183791 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184012 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184095 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184317 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184408 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184621 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184705 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.184928 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185011 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185235 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185377 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185541 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185624 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185850 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.185935 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186181 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186283 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186490 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186573 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186794 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.186891 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187116 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187200 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187426 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187516 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187777 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.187889 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188103 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188239 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188668 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188765 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188765 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.188926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189007 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189085 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189290 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189426 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189598 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189693 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189913 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.189997 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190251 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190337 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190561 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190654 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190887 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.190979 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191200 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191281 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191506 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191597 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191814 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.191897 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192128 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192235 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192438 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192541 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192748 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.192877 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193056 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193147 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193370 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193455 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193679 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193762 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.193988 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194122 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194339 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194424 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194652 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194741 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.194963 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195055 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195286 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195376 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195603 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195688 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.195908 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196000 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196217 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196300 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196521 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196604 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196826 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.196918 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197128 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197212 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197436 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197530 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197736 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.197827 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198038 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198139 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198363 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198446 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198666 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198751 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.198969 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199060 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199271 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199361 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199579 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199668 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199877 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.199961 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200178 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200261 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200477 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200605 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200794 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.200876 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201105 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201202 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201411 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201714 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.201806 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202079 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202179 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202380 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202468 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202698 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.202779 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.203015 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.203111 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.203327 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.203504 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.203779 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204132 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204214 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204373 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204453 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204531 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204685 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204806 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.204998 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205120 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205310 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205442 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205625 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205755 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.205947 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206106 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206285 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206420 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206609 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206741 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.206923 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207047 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207245 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207362 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207560 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207702 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.207881 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208033 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208189 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208348 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208507 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208666 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208846 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.208977 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.209178 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.209289 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.209496 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.209722 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.209817 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.210139 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.210309 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.210457 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.210767 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.210859 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.211085 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.211398 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.211493 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.211707 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.211789 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212028 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212113 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212342 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212426 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212662 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.212974 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.213103 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.213298 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.213405 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.213607 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.213925 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214010 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214258 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214343 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214576 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214672 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214907 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.214997 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215237 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215321 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215547 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215631 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215855 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.215939 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216179 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216272 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216487 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216570 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216796 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.216956 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.217108 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.217417 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.217507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.217732 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.218046 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.218184 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.218379 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.218634 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.218720 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219040 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219193 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219351 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219510 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219655 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219755 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.219929 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220235 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220355 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220540 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220681 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.220855 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221090 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221225 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221430 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221666 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221824 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.221962 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222124 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222275 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222419 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222611 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222763 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.222898 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223033 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223225 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223363 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223614 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223771 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.223907 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.224210 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.224308 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.224553 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.224772 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.224929 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.226812 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.226920 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227002 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227002 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227144 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227239 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227321 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227407 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227407 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227549 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227636 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227722 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.227833 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228025 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228163 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228495 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228660 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228791 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.228927 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229112 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229254 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229428 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229576 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229742 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.229930 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230086 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230220 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230395 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230524 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230711 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.230808 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231024 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231119 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231338 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231425 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231652 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231743 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.231963 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232046 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232273 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232358 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232585 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232668 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232900 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.232984 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.233212 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.233490 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.233586 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.233815 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.233898 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.234161 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.234261 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.234488 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.234897 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.235036 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.235225 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.235540 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.235637 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.235892 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236088 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236246 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236555 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236661 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236867 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.236979 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237175 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237308 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237482 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237646 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237796 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.237982 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.238114 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.238424 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.238513 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.238731 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239012 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239109 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239336 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239420 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239638 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239733 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.239945 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240038 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240250 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240364 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240556 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240646 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240865 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.240963 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.241170 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.241261 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.241475 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.241630 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.241799 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.242133 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.242219 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.242441 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.242746 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.242841 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.243050 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.243312 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.243444 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.243686 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.243880 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244030 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244215 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244362 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244534 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244670 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244837 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.244977 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245150 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245286 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245480 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245612 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245796 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.245921 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246131 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246252 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246442 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246558 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246749 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.246869 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.247178 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.247275 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.247482 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.247738 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.247822 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.248094 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.248306 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.248391 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.248701 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.248832 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.249005 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.249303 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.249481 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.249618 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.249929 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.250100 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.250327 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.250594 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251036 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251036 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251161 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251329 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251531 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251625 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.251940 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252023 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252248 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252590 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252858 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.252984 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.253171 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.253482 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.253599 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.253795 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.253940 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254108 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254250 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254406 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254555 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254695 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254831 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.254993 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255151 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255295 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255465 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255607 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255775 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.255925 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256093 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256234 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256406 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256551 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256741 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.256892 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257046 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257186 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257363 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257659 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257770 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.257962 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258195 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258371 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258511 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258647 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258796 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.258933 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259077 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259239 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259408 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259577 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259692 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259800 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.259971 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260094 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260267 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260380 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260585 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260715 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.260951 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.261047 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.261263 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.261456 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.261577 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.261901 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262028 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262249 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262361 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262554 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262674 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.262864 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263138 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263138 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263346 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263455 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263549 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263742 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.263868 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264050 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264162 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264354 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264497 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264654 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264835 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.264957 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.265260 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.265344 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.265565 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.265743 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266207 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266349 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266511 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266633 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266844 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.266969 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.267242 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.267518 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.267628 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.267831 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.267941 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268183 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268301 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268491 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268600 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268807 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.268915 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269119 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269238 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269441 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269551 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269757 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.269873 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270087 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270201 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270405 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270515 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270717 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.270842 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.271025 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.271146 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.271348 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.271467 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272094 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272186 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272267 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272344 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272421 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272497 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272582 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272661 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272834 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.272919 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273147 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273238 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273459 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273544 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273771 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.273854 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274105 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274205 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274421 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274513 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274724 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.274806 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275035 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275126 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275347 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275438 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275652 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275735 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.275960 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276058 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276271 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276354 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276580 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276670 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.276892 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277012 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277204 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277331 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277517 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277662 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277828 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.277977 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278163 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278354 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278498 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278662 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278815 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.278925 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279062 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279241 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279386 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279551 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279697 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.279997 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280082 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280303 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280387 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280612 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280704 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.280919 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.281003 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.281226 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.281309 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.281580 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282252 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282366 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282449 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282527 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282604 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282691 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282778 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.282927 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283013 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283244 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283329 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283561 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283646 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283875 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.283960 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284184 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284271 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284601 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284806 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.284898 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285132 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285224 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285441 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285526 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285748 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.285841 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286070 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286171 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286397 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286482 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286703 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.286788 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287004 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287095 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287306 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287428 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287607 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287742 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.287927 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288066 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288231 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288468 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288553 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288782 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.288947 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289094 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289256 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289418 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289561 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289741 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.289972 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290084 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290308 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290395 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290617 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290702 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.290938 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291023 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291262 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291360 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291593 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291728 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291898 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.291995 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292212 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292301 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292516 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292600 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292834 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.292936 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293156 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293242 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293548 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293779 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.293863 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294101 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294217 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294428 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294544 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294748 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.294845 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295063 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295174 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295384 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295502 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295796 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.295889 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296104 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296187 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296414 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296496 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296718 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.296818 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.297030 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.297202 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.297434 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.297863 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.297975 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298073 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298147 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298335 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298424 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298646 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298740 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.298959 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299045 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299266 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299358 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299578 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299670 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299887 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.299972 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300197 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300281 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300605 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300817 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.300910 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301122 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301206 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301440 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301524 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301752 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.301848 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302073 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302200 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302389 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302476 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302697 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.302797 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303003 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303088 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303313 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303399 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303639 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303724 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.303951 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304035 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304257 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304343 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304564 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304665 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304869 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.304968 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305212 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305304 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305517 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305603 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305840 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.305933 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306191 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306278 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306519 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306620 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306827 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.306919 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307129 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307213 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307441 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307526 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307746 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.307840 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308052 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308137 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308357 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308441 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308667 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308753 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.308968 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309051 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309268 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309359 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309569 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309652 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309873 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.309958 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310201 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310298 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310601 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310810 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.310894 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311114 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311198 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311416 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311501 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311736 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.311889 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312007 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312136 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312326 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312410 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312634 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.312719 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313059 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313413 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313504 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313591 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313659 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313842 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.313949 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314211 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314301 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314518 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314602 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314853 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.314937 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315176 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315263 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315501 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315594 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315820 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.315913 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316131 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316222 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316446 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316529 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316758 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.316849 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317073 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317165 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317387 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317469 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317701 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.317862 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318017 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318295 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318391 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318627 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318712 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.318945 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319038 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319286 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319424 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319574 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319668 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319890 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.319991 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.320200 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.320450 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.320542 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.320786 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.320889 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321103 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321194 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321411 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321496 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321725 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.321809 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322040 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322205 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322379 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322472 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.322784 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323006 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323097 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323318 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323411 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323633 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323754 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.323951 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324036 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324269 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324405 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324596 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324694 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324910 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.324993 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325228 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325313 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325545 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325627 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325861 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.325944 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326207 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326298 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326522 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326606 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326840 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.326937 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327156 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327249 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327469 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327551 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327780 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.327872 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328092 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328175 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328563 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328703 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328795 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.328884 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329129 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329226 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329448 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329533 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329757 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.329842 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330089 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330188 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330410 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330493 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330726 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.330934 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331049 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331252 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331387 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331588 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331710 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.331916 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332025 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332244 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332330 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332567 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332653 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.332889 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333141 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333225 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333454 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333546 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333787 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.333919 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334122 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334209 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334439 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334535 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334748 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.334833 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335069 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335152 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335378 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335471 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335681 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335765 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.335986 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336078 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336297 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336382 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336604 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336828 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.336913 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337187 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337281 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337505 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337806 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.337897 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338149 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338249 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338462 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338547 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338770 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.338992 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339084 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339348 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339445 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339664 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339767 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.339983 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340076 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340296 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340380 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340608 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340692 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.340941 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341043 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341222 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341313 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341534 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341618 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341836 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.341927 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342171 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342260 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342479 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342564 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.342884 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343085 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343177 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343391 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343475 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343696 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.343780 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344016 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344115 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344344 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344718 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344812 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344892 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.344982 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345061 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345219 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345304 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345525 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345619 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345829 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.345912 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346172 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346260 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346478 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346565 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.346873 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347084 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347249 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347392 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347507 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347703 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.347803 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348004 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348099 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348312 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348397 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348615 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348700 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.348925 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349020 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349228 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349320 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349537 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349621 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.349854 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.350325 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.350563 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.350648 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.350879 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.350962 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.351189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.351286 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.351507 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.351736 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.351822 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352072 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352168 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352398 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352487 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352715 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.352798 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353055 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353147 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353424 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353674 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353756 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353888 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.353973 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.354250 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.354339 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.354571 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.354691 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.354903 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355003 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355214 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355297 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355524 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355613 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355831 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.355923 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356134 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356226 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356445 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356528 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356754 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.356845 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357062 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357154 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357368 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357451 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357677 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357768 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.357982 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358126 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358320 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358416 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358629 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358724 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.358936 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359019 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359245 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359329 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359551 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359737 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.359971 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360385 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360479 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360559 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360647 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360729 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.360841 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361039 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361145 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361390 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361476 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361712 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.361796 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362029 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362143 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362371 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362457 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362690 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.362774 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363001 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363310 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363426 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363620 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363749 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.363928 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364072 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364242 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364383 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364572 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364708 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.364888 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365030 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365192 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365342 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365611 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365697 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.365924 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366020 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366272 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366369 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366593 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366732 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366903 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.366989 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367224 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367308 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367546 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367632 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367849 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.367933 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368166 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368249 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368475 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368567 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368791 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.368875 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369102 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369194 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369407 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369505 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369712 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.369798 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370021 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370125 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370349 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370450 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370652 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370736 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.370953 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371044 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371258 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371351 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371567 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371652 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371867 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.371950 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372169 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372260 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372471 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372767 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.372856 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373067 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373167 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373365 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373455 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373666 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373750 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.373969 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374115 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374293 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374386 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374594 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374684 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.374889 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375018 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375304 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375564 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375904 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.375994 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376110 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376197 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376425 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376509 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376733 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.376820 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377042 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377134 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377348 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377432 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377652 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377737 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.377957 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378100 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378319 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378427 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378656 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378742 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.378973 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379065 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379297 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379609 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379694 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.379929 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380012 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380241 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380335 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380563 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380647 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380878 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.380962 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381195 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381292 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381504 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381596 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381812 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.381896 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382161 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382261 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382476 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382609 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382787 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.382880 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383098 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383191 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383409 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383493 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383719 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.383803 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384034 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384125 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384348 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384433 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384650 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384732 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.384965 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385092 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385278 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385363 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385595 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385691 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385910 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.385993 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386245 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386331 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386575 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386673 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386887 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.386978 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387195 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387277 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387511 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387603 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387820 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.387948 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388128 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388214 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388443 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388529 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.388849 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389087 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389170 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389403 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389527 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389708 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389791 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.389950 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:26:48.390033 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.390375 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.390719 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.391120 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392334 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392334 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392334 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392334 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392684 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:26:48.392880 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:26:48.550550 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Registered counter for database nova_api Jun 21 10:26:48.551047 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO dbcounter [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Registered counter for database nova_api Jun 21 10:26:48.571603 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.573327 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_db.sqlalchemy.engines [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.579986 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.580202 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writer thread running {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.638740 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.context [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),002ebcf0-7789-424b-b18d-3bf9b98012a2(cell1) {{(pid=103347) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 10:26:48.639362 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.context [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),002ebcf0-7789-424b-b18d-3bf9b98012a2(cell1) {{(pid=103346) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 10:26:48.643081 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:26:48.643327 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:26:48.644700 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:26:48.644964 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:26:48.645480 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:26:48.645767 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:26:48.647451 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_concurrency.lockutils [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:26:48.647764 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:26:48.649471 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Registered counter for database nova_cell0 Jun 21 10:26:48.649757 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO dbcounter [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Registered counter for database nova_cell0 Jun 21 10:26:48.653707 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Registered counter for database nova_cell1 Jun 21 10:26:48.653849 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO dbcounter [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Registered counter for database nova_cell1 Jun 21 10:26:48.661244 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_db.sqlalchemy.engines [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.663013 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.667151 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writer thread running {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.667311 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.668738 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_db.sqlalchemy.engines [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.673789 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.675558 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.810436 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writer thread running {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.819136 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO dbcounter [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Registered counter for database nova_cell0 Jun 21 10:26:48.819754 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO dbcounter [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Registered counter for database nova_cell0 Jun 21 10:26:48.826502 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.828254 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_db.sqlalchemy.engines [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:26:48.831730 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writer thread running {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:48.833041 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writer thread running {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:26:49.172813 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: WARNING keystonemiddleware.auth_token [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:26:49.180566 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: WARNING keystonemiddleware.auth_token [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:26:49.181077 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:26:49.189479 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:26:49.527284 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: WARNING keystonemiddleware.auth_token [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:26:49.533316 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: WARNING keystonemiddleware.auth_token [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:26:49.538684 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ff02379c0 pid: 103346 (default app) Jun 21 10:26:49.540820 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:26:49.542012 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Jun 21 10:26:49.542444 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Tue Jun 21 10:26:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:26:49.546877 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:26:49.553970 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: WARNING keystonemiddleware.auth_token [None req-b0ae945e-32f5-4b78-a80a-046f4016f1bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:26:49.559641 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ff02379c0 pid: 103347 (default app) Jun 21 10:28:11.436576 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:11.437722 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jun 21 10:28:11.438624 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:11.452914 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:11.453905 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell1:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:11.455755 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell0:SELECT=3 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:11.457167 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:12.068048 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-6f652996-b75c-47b0-b7b2-321e955a1cbf admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:12.111541 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-6f652996-b75c-47b0-b7b2-321e955a1cbf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.665331 Jun 21 10:28:12.112309 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 21 10:28:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:14.495318 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:14.496330 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-f5979a68-cdc8-4943-b277-1c404a9bdecc None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 21 10:28:14.496706 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:14.568352 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-b60d2b57-b735-4f0d-b579-6ca105db9098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:14.587595 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:28:14.587595 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jun 21 10:28:14.623856 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-b60d2b57-b735-4f0d-b579-6ca105db9098 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.117769 Jun 21 10:28:14.624575 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:14.639600 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_api:SELECT=3 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:14.641081 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_cell0:SELECT=3 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:14.642209 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_cell1:SELECT=3 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:14.642980 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:14.859621 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-08481065-d2c1-4fe5-841b-4ad95e6d1f17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:14.862189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:28:14.862189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:28:14.928171 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-08481065-d2c1-4fe5-841b-4ad95e6d1f17 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295103 Jun 21 10:28:14.928892 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 21 10:28:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:28:17.021533 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-b60d2b57-b735-4f0d-b579-6ca105db9098 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:17.022859 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-b60d2b57-b735-4f0d-b579-6ca105db9098 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Jun 21 10:28:17.023378 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:17.144632 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-31db86de-fcc5-431f-b337-bbe081d599b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:17.163201 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:28:17.163201 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:28:17.188716 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-31db86de-fcc5-431f-b337-bbe081d599b9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158785 Jun 21 10:28:17.189265 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:17.201455 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-56dd2a3f-1cb0-4501-b019-8dcfa27a2791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:17.203052 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:28:17.203052 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: warnings.warn(msg) Jun 21 10:28:17.260857 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-56dd2a3f-1cb0-4501-b019-8dcfa27a2791 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063141 Jun 21 10:28:17.261450 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 21 10:28:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:19.396842 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-31db86de-fcc5-431f-b337-bbe081d599b9 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:19.397866 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-31db86de-fcc5-431f-b337-bbe081d599b9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 21 10:28:19.398460 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:19.460636 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a8e2322a-9704-4bc3-9e92-5996b1de1473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "id": "d2", "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:19.488373 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a8e2322a-9704-4bc3-9e92-5996b1de1473 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083912 Jun 21 10:28:19.494167 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:19.504590 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-28737651-3759-4acd-9ff0-a07bd88c6361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:19.536647 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-28737651-3759-4acd-9ff0-a07bd88c6361 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037909 Jun 21 10:28:19.537756 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 21 10:28:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:21.708590 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a8e2322a-9704-4bc3-9e92-5996b1de1473 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:21.709602 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a8e2322a-9704-4bc3-9e92-5996b1de1473 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 21 10:28:21.709969 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:21.770480 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-53f1ce1e-8990-4d7f-af98-9167cc368ec7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:21.788374 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-53f1ce1e-8990-4d7f-af98-9167cc368ec7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071884 Jun 21 10:28:21.788942 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 10:28:21.801028 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-30ed7421-8f88-44ca-9fca-f59e7ac7ac9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:21.825294 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-30ed7421-8f88-44ca-9fca-f59e7ac7ac9f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027891 Jun 21 10:28:21.826599 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 21 10:28:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:28:23.927504 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-53f1ce1e-8990-4d7f-af98-9167cc368ec7 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:23.928543 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-53f1ce1e-8990-4d7f-af98-9167cc368ec7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 21 10:28:23.928972 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:23.999129 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:24.018905 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081734 Jun 21 10:28:24.019714 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:24.032272 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-ab1a2957-158f-4242-ac77-565f54e262e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:24.057367 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-ab1a2957-158f-4242-ac77-565f54e262e5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029438 Jun 21 10:28:24.058072 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Tue Jun 21 10:28:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:26.196340 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:26.197791 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 21 10:28:26.198537 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:26.261049 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-a2ad8edd-0199-46b2-a558-3d3bc89fe1a9 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:26.286182 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-a2ad8edd-0199-46b2-a558-3d3bc89fe1a9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081089 Jun 21 10:28:26.286995 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 21 10:28:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:28:28.436757 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:28.437893 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-afff317f-edb5-46d1-8047-f1cb46c1ae20 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jun 21 10:28:28.438354 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:28.500581 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-9a7d0ff6-340a-4415-a4f9-506de75c79f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:28.520246 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-9a7d0ff6-340a-4415-a4f9-506de75c79f7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075756 Jun 21 10:28:28.520803 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:28.537435 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-ae7c206b-0fd6-4311-bd6b-1b05e225159b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:28.567958 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-ae7c206b-0fd6-4311-bd6b-1b05e225159b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035708 Jun 21 10:28:28.568557 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 21 10:28:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:30.833522 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-9a7d0ff6-340a-4415-a4f9-506de75c79f7 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:30.834633 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-9a7d0ff6-340a-4415-a4f9-506de75c79f7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jun 21 10:28:30.835101 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:30.916518 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a8aed1a5-4bad-4fbd-886e-7606598019f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:30.940617 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a8aed1a5-4bad-4fbd-886e-7606598019f2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.098339 Jun 21 10:28:30.942115 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:30.956608 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-614b281f-f5b0-41e9-96c5-1c28997b56ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:30.983210 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-614b281f-f5b0-41e9-96c5-1c28997b56ad admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030556 Jun 21 10:28:30.983870 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 21 10:28:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:28:33.229399 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-a8aed1a5-4bad-4fbd-886e-7606598019f2 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:33.230541 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-a8aed1a5-4bad-4fbd-886e-7606598019f2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Jun 21 10:28:33.230959 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:33.312608 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-6ea64aa5-2293-418d-b18e-f7f54e14cf31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:33.334296 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-6ea64aa5-2293-418d-b18e-f7f54e14cf31 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.096114 Jun 21 10:28:33.334900 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:33.348365 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-fc6d7745-e1d1-4ac3-8fcb-fec29126b544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:33.378204 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-fc6d7745-e1d1-4ac3-8fcb-fec29126b544 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033927 Jun 21 10:28:33.379106 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 21 10:28:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:35.487828 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-6ea64aa5-2293-418d-b18e-f7f54e14cf31 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:35.488850 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-6ea64aa5-2293-418d-b18e-f7f54e14cf31 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 21 10:28:35.489454 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:35.551824 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9b09ec3e-fccf-4ec5-aa72-8eeea2cc54eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:35.571852 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9b09ec3e-fccf-4ec5-aa72-8eeea2cc54eb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076394 Jun 21 10:28:35.572434 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 10:28:35.585070 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-7bcb7336-c86d-404c-9180-8af701361cd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:35.610926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-7bcb7336-c86d-404c-9180-8af701361cd8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029921 Jun 21 10:28:35.611542 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 21 10:28:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:28:37.800756 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9b09ec3e-fccf-4ec5-aa72-8eeea2cc54eb admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:28:37.802597 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9b09ec3e-fccf-4ec5-aa72-8eeea2cc54eb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Jun 21 10:28:37.803182 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:28:37.878825 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "disk": 160}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:37.899018 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089092 Jun 21 10:28:37.899834 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Tue Jun 21 10:28:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:28:37.912612 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-e520b48d-be9a-4f4a-9119-f3981a4958b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:28:37.940128 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-e520b48d-be9a-4f4a-9119-f3981a4958b7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031165 Jun 21 10:28:37.940835 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Tue Jun 21 10:28:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:29:03.901150 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:03.902254 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jun 21 10:29:03.902632 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:03.913678 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:03.968521 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-ab603d77-4dba-42bd-875f-e596d27d1089 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:03.986504 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-ab603d77-4dba-42bd-875f-e596d27d1089 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077339 Jun 21 10:29:03.987053 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 21 10:29:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:29:04.941312 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:04.942360 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-b72594fb-b5e6-4452-bb81-90b57e6b935e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 21 10:29:04.942755 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:05.140416 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-06c8c4ea-743a-4866-953a-ed310f0b6776 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:05.146330 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-06c8c4ea-743a-4866-953a-ed310f0b6776 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-06c8c4ea-743a-4866-953a-ed310f0b6776 admin admin] Request method failure captured: Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept: application/json Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Host: 10.222.0.43 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABisZ1wTYdHDPUPTz6NtFUKPXfuNLYpdaoTTXDM_geN5967f02gFxzC-6jzKzyQ8k18OST6JLn1kZ_xOM8cLFLSXtkFF5xGQGlHMlr5Bpiaa_AskGq5ot2VdjLgWwTf96ttiv-ep7NoIqFruLf4zPeP1nCtWEAKPBT1Sy0nnPvfXp5GA-E Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Role: reader,member,admin Jun 21 10:29:05.149715 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Roles: reader,member,admin Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User: admin Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: method: > Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: exception: Flavor 42 could not be found. Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: action_args: {'id': '42'} Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:05.152243 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:05.153801 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.156026 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-06c8c4ea-743a-4866-953a-ed310f0b6776 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:05.158414 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-06c8c4ea-743a-4866-953a-ed310f0b6776 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070117 Jun 21 10:29:05.158414 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 21 10:29:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:05.162695 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-40de8372-107e-4058-9bc6-f9dcf2696fba admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:05.165808 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:05.186614 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-40de8372-107e-4058-9bc6-f9dcf2696fba admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028225 Jun 21 10:29:05.187180 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:29:05.197322 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-f348115a-2a8f-4a4c-a287-720cad475646 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:05.220949 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-f348115a-2a8f-4a4c-a287-720cad475646 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027132 Jun 21 10:29:05.221526 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:29:05.232500 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-331f06e5-0937-4667-bd1d-d14eb70c429a admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:05.239015 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.wsgi [None req-331f06e5-0937-4667-bd1d-d14eb70c429a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-331f06e5-0937-4667-bd1d-d14eb70c429a admin admin] Request method failure captured: Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept: application/json Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept-Encoding: gzip, deflate Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Connection: keep-alive Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Content-Length: 0 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Host: 10.222.0.43 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-System-Scope: None Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: User-Agent: python-novaclient Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Auth-Token: gAAAAABisZ1wTYdHDPUPTz6NtFUKPXfuNLYpdaoTTXDM_geN5967f02gFxzC-6jzKzyQ8k18OST6JLn1kZ_xOM8cLFLSXtkFF5xGQGlHMlr5Bpiaa_AskGq5ot2VdjLgWwTf96ttiv-ep7NoIqFruLf4zPeP1nCtWEAKPBT1Sy0nnPvfXp5GA-E Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Id: None Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Name: None Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Identity-Status: Confirmed Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Is-Admin-Project: True Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Id: default Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Name: Default Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Name: admin Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Role: reader,member,admin Jun 21 10:29:05.242423 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Roles: reader,member,admin Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant: admin Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Name: admin Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User: admin Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Id: default Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Name: Default Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Name: admin Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: method: > Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: exception: Flavor 42 could not be found. Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: action_args: {'id': '42'} Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:05.244066 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:05.246506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:05.247555 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-331f06e5-0937-4667-bd1d-d14eb70c429a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:05.248549 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-331f06e5-0937-4667-bd1d-d14eb70c429a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016108 Jun 21 10:29:05.248549 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 21 10:29:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 10:29:06.087779 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-f348115a-2a8f-4a4c-a287-720cad475646 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:06.088850 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-f348115a-2a8f-4a4c-a287-720cad475646 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 21 10:29:06.089254 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:06.283913 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-4c134d68-2698-4001-9b5d-38412abb84f1 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:06.292268 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.wsgi [None req-4c134d68-2698-4001-9b5d-38412abb84f1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-4c134d68-2698-4001-9b5d-38412abb84f1 admin admin] Request method failure captured: Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept: application/json Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept-Encoding: gzip, deflate Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Connection: keep-alive Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Content-Length: 0 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Host: 10.222.0.43 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-System-Scope: None Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: User-Agent: python-novaclient Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Auth-Token: gAAAAABisZ1ygK63iby6uFohwHHy-88oWEutC8cvE9d_Mp_vbwfp6PEDuQX2CtEc-CPKuw7sOjunUi5fEwGNxsUTbnzeyN_GAD3z-5Xl9wmyGEg_ERnB-grri48Aw1qdutNVPNdOnGYxepyqjecYXaSNB24rOObso3W-enBW1tKMtuFEzzu_W7Y Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Id: None Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Name: None Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Identity-Status: Confirmed Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Is-Admin-Project: True Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Id: default Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Name: Default Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Name: admin Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Role: reader,member,admin Jun 21 10:29:06.293918 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Roles: reader,member,admin Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant: admin Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Name: admin Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User: admin Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Id: default Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Name: Default Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Name: admin Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: method: > Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: exception: Flavor 84 could not be found. Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: action_args: {'id': '84'} Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:06.295382 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:06.297465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.298694 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-4c134d68-2698-4001-9b5d-38412abb84f1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:06.299770 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-4c134d68-2698-4001-9b5d-38412abb84f1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068141 Jun 21 10:29:06.299770 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 21 10:29:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:06.305350 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-9e7bab02-a03d-46a1-9177-c77b1353d10a admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:06.320255 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-9e7bab02-a03d-46a1-9177-c77b1353d10a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018517 Jun 21 10:29:06.320823 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:29:06.331875 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-43768947-c975-4d0b-8190-546881608ecb admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:06.346533 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-43768947-c975-4d0b-8190-546881608ecb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018188 Jun 21 10:29:06.347152 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:29:06.357263 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-cd7e6ab0-7d84-412e-9691-64bd82c3fa63 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:06.363349 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-cd7e6ab0-7d84-412e-9691-64bd82c3fa63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-cd7e6ab0-7d84-412e-9691-64bd82c3fa63 admin admin] Request method failure captured: Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept: application/json Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Host: 10.222.0.43 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABisZ1ygK63iby6uFohwHHy-88oWEutC8cvE9d_Mp_vbwfp6PEDuQX2CtEc-CPKuw7sOjunUi5fEwGNxsUTbnzeyN_GAD3z-5Xl9wmyGEg_ERnB-grri48Aw1qdutNVPNdOnGYxepyqjecYXaSNB24rOObso3W-enBW1tKMtuFEzzu_W7Y Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Role: reader,member,admin Jun 21 10:29:06.364871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Roles: reader,member,admin Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User: admin Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: method: > Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: exception: Flavor 84 could not be found. Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: action_args: {'id': '84'} Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:06.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:06.367437 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:06.368654 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-cd7e6ab0-7d84-412e-9691-64bd82c3fa63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:06.370151 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-cd7e6ab0-7d84-412e-9691-64bd82c3fa63 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012911 Jun 21 10:29:06.370151 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Tue Jun 21 10:29:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:07.205859 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-43768947-c975-4d0b-8190-546881608ecb admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:07.206956 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-43768947-c975-4d0b-8190-546881608ecb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 21 10:29:07.207360 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:07.402954 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-37c6b095-69fc-4522-90bc-5398b4336770 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:07.409050 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.wsgi [None req-37c6b095-69fc-4522-90bc-5398b4336770 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-37c6b095-69fc-4522-90bc-5398b4336770 admin admin] Request method failure captured: Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept: application/json Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Accept-Encoding: gzip, deflate Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Connection: keep-alive Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Content-Length: 0 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Host: 10.222.0.43 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Openstack-System-Scope: None Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: User-Agent: python-novaclient Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Auth-Token: gAAAAABisZ1zXqaaUKeEstFiVRMRCKAh9URdx8prlobTWx4nXqzyahQm4n8c_lLJLugCzyVC2_QBIbRlY1ECyvQB5p1xcvPkVxDJhSC1pBVTIw0wPxyrh-L61g2ZvkhQCo3ISTHCTJArllir_enVcPZJEQvGaelS2tYed367QQ-zocNkmi7GIPE Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Id: None Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Domain-Name: None Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Identity-Status: Confirmed Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Is-Admin-Project: True Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Id: default Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Domain-Name: Default Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Project-Name: admin Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Role: reader,member,admin Jun 21 10:29:07.410589 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Roles: reader,member,admin Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant: admin Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-Tenant-Name: admin Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User: admin Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Id: default Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Domain-Name: Default Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: X-User-Name: admin Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: method: > Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: exception: Flavor 451 could not be found. Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: action_args: {'id': '451'} Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:07.412098 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:07.414110 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.415390 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-37c6b095-69fc-4522-90bc-5398b4336770 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:07.416606 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-37c6b095-69fc-4522-90bc-5398b4336770 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064923 Jun 21 10:29:07.416606 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:29:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:07.422231 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-81d69cdd-75da-40aa-8954-9b0671b5e9e3 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:07.436889 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-81d69cdd-75da-40aa-8954-9b0671b5e9e3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018289 Jun 21 10:29:07.437431 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:29:07.452758 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:07.467731 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019430 Jun 21 10:29:07.468308 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Tue Jun 21 10:29:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:29:07.478818 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-c5b088b2-2c7f-445c-9d63-d0736477773d admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:07.484766 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.wsgi [None req-c5b088b2-2c7f-445c-9d63-d0736477773d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-c5b088b2-2c7f-445c-9d63-d0736477773d admin admin] Request method failure captured: Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept: application/json Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Accept-Encoding: gzip, deflate Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Connection: keep-alive Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Content-Length: 0 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Host: 10.222.0.43 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-Api-Version: compute 2.90 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Openstack-System-Scope: None Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: User-Agent: python-novaclient Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Auth-Token: gAAAAABisZ1zXqaaUKeEstFiVRMRCKAh9URdx8prlobTWx4nXqzyahQm4n8c_lLJLugCzyVC2_QBIbRlY1ECyvQB5p1xcvPkVxDJhSC1pBVTIw0wPxyrh-L61g2ZvkhQCo3ISTHCTJArllir_enVcPZJEQvGaelS2tYed367QQ-zocNkmi7GIPE Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Id: None Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Domain-Name: None Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Identity-Status: Confirmed Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Is-Admin-Project: True Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Id: default Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Domain-Name: Default Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Project-Name: admin Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Role: reader,member,admin Jun 21 10:29:07.486332 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Roles: reader,member,admin Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebccc8110983425eae462769b51519c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebccc8110983425eae462769b51519c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebccc8110983425eae462769b51519c6"}]}] Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant: admin Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Id: ebccc8110983425eae462769b51519c6 Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-Tenant-Name: admin Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User: admin Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Id: default Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Domain-Name: Default Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Id: b6ff555140924a9182c287c0588e7e67 Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: X-User-Name: admin Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: method: > Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: exception: Flavor 451 could not be found. Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: action_args: {'id': '451'} Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:29:07.487780 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:07.488804 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: ERROR nova.api.openstack.wsgi Jun 21 10:29:07.489926 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-c5b088b2-2c7f-445c-9d63-d0736477773d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:29:07.491028 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-c5b088b2-2c7f-445c-9d63-d0736477773d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012612 Jun 21 10:29:07.491028 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:29:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:08.321964 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:08.323197 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jun 21 10:29:08.323598 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:08.520872 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-24eb1fd9-cd07-4bc7-a40b-9e4c3d43c5e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:29:08.541429 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-24eb1fd9-cd07-4bc7-a40b-9e4c3d43c5e5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078341 Jun 21 10:29:08.542287 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 21 10:29:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:29:09.388988 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:09.390009 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 21 10:29:09.390439 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:09.585651 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-45f307e7-536f-4779-b6cb-c19f2f3510ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:29:09.605237 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-45f307e7-536f-4779-b6cb-c19f2f3510ac admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076754 Jun 21 10:29:09.605792 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 21 10:29:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:29:10.480247 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:10.481278 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 21 10:29:10.481668 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:10.678180 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-4d6e216e-74e2-4785-8fa8-2d7913e25b9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:29:10.703400 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-4d6e216e-74e2-4785-8fa8-2d7913e25b9f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082973 Jun 21 10:29:10.704401 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 21 10:29:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:29:11.543572 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:11.544616 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 21 10:29:11.545012 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:11.737174 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-d9365cbb-ff4f-440f-93d0-853e603e467e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:29:11.756855 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-d9365cbb-ff4f-440f-93d0-853e603e467e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074821 Jun 21 10:29:11.757416 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Tue Jun 21 10:29:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:29:12.592647 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:12.593871 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 21 10:29:12.598185 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:29:12.788583 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-f8d65ad4-7b57-436f-bea5-799e64698010 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:29:12.809089 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-f8d65ad4-7b57-436f-bea5-799e64698010 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076345 Jun 21 10:29:12.809559 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Tue Jun 21 10:29:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:30:02.121005 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.122432 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-70edbff3-3ebe-498e-ac49-03aef7687652 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Jun 21 10:30:02.122978 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:30:02.141647 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:30:02.224771 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-e41416cf-6efe-474c-9994-966ad26eac53 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.247793 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-e41416cf-6efe-474c-9994-966ad26eac53 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.115031 Jun 21 10:30:02.248410 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:30:02.276094 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-5566b06e-1a8b-406f-acf2-d63f51121a65 admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.280166 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG dbcounter [-] [103347] Writing DB stats nova_api:SELECT=14 {{(pid=103347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:30:02.286927 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-5566b06e-1a8b-406f-acf2-d63f51121a65 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015423 Jun 21 10:30:02.287565 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:30:02.300725 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-1906634e-deef-4017-9576-4959a5c32108 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.309601 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-1906634e-deef-4017-9576-4959a5c32108 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012811 Jun 21 10:30:02.310214 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:30:02.324086 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.333355 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014268 Jun 21 10:30:02.333976 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:30:02.348595 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-6bec2c99-6900-4892-a961-a7a5a96b8178 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:30:02.358393 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-6bec2c99-6900-4892-a961-a7a5a96b8178 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015037 Jun 21 10:30:02.359025 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Tue Jun 21 10:30:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:33:29.243015 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:29.244052 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 21 10:33:29.244484 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:33:29.387579 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_api:SELECT=6 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:29.507506 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:29.508676 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:33:29.508676 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:33:29.509996 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:29.510462 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:29.511247 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:29.511675 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:29.545885 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-52d63d2b-603b-4b84-a533-5ff050b4ea9a admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159666 Jun 21 10:33:29.546465 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:33:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:33:30.390464 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:30.392853 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 21 10:33:30.392853 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:33:30.589439 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:30.590648 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:33:30.590648 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:33:30.591872 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:30.592354 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:30.593136 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:30.593562 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:30.613865 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-58841240-6f64-47b5-8d5d-e0b6f7e91fca admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081732 Jun 21 10:33:30.614501 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:33:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:33:41.880887 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:41.882078 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Jun 21 10:33:41.882494 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:33:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:33:42.032383 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_cell0:SELECT=4 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:42.033237 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_cell1:SELECT=4 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:42.034189 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG dbcounter [-] [103346] Writing DB stats nova_api:SELECT=8 {{(pid=103346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:42.088158 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:42.089978 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:33:42.089978 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:33:42.091751 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:42.092381 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:42.093601 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:42.094311 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:42.121774 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-ee379b0a-dd94-429e-89e4-fc6a014be324 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097777 Jun 21 10:33:42.122371 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:33:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:33:42.994431 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: DEBUG nova.api.openstack.wsgi [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] Calling method '>' {{(pid=103347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:42.995946 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: INFO nova.api.openstack.requestlog [None req-aa86884a-6ce8-4921-a7da-7f17c467b5be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Jun 21 10:33:42.996583 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: [pid: 103347|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Tue Jun 21 10:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:33:43.198207 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG nova.api.openstack.wsgi [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] Calling method '>' {{(pid=103346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:33:43.199367 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:33:43.199367 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: warnings.warn(msg) Jun 21 10:33:43.200553 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:43.200982 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:43.201744 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:33:43.202195 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: DEBUG oslo_concurrency.lockutils [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:33:43.224742 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: INFO nova.api.openstack.requestlog [None req-20a625d2-46d2-4726-b9a2-dcd55c6ad4ab admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085295 Jun 21 10:33:43.225455 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: [pid: 103346|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Tue Jun 21 10:33:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:34:41.912759 dv-cinder-836973-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 10:34:41.913689 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: Tue Jun 21 10:34:41 2022 - graceful shutdown triggered... Jun 21 10:34:41.914192 dv-cinder-836973-8-iscsi devstack@n-api.service[103346]: Gracefully killing worker 1 (pid: 103346)... Jun 21 10:34:41.914678 dv-cinder-836973-8-iscsi devstack@n-api.service[103347]: Gracefully killing worker 2 (pid: 103347)... Jun 21 10:34:42.915012 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: worker 1 buried after 1 seconds Jun 21 10:34:42.915012 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: worker 2 buried after 1 seconds Jun 21 10:34:42.915012 dv-cinder-836973-8-iscsi devstack@n-api.service[103345]: goodbye to uWSGI. Jun 21 10:34:42.916832 dv-cinder-836973-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 10:34:42.917391 dv-cinder-836973-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 10:34:42.920291 dv-cinder-836973-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 10:34:42.929850 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 10:34:42.933196 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 10:34:42 2022] *** Jun 21 10:34:42.933391 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 10:34:42.933524 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 10:34:42.933684 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: nodename: dv-cinder-836973-8-iscsi Jun 21 10:34:42.933807 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: machine: x86_64 Jun 21 10:34:42.933917 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: clock source: unix Jun 21 10:34:42.934024 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: pcre jit disabled Jun 21 10:34:42.934159 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: detected number of CPU cores: 4 Jun 21 10:34:42.934269 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: current working directory: / Jun 21 10:34:42.934376 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: detected binary path: /usr/bin/uwsgi-core Jun 21 10:34:42.934516 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: your processes number limit is 47680 Jun 21 10:34:42.934681 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: your memory page size is 4096 bytes Jun 21 10:34:42.934681 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: detected max file descriptor number: 2048 Jun 21 10:34:42.934681 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: lock engine: pthread robust mutexes Jun 21 10:34:42.934973 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: thunder lock: enabled Jun 21 10:34:42.935052 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 10:34:42.935121 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 10:34:42.982940 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: Python main interpreter initialized at 0x55e3c57ff9c0 Jun 21 10:34:42.982940 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: python threads support enabled Jun 21 10:34:42.982940 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: your server socket listen backlog is limited to 100 connections Jun 21 10:34:42.982940 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: your mercy for graceful operations on workers is 90 seconds Jun 21 10:34:42.983415 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 10:34:42.983415 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: *** Operational MODE: preforking *** Jun 21 10:34:42.983668 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: *** uWSGI is running in multiple interpreter mode *** Jun 21 10:34:42.983668 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: spawned uWSGI master process (pid: 124162) Jun 21 10:34:42.983859 dv-cinder-836973-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 10:34:42.984418 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: spawned uWSGI worker 1 (pid: 124179, cores: 1) Jun 21 10:34:42.984951 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: spawned uWSGI worker 2 (pid: 124180, cores: 1) Jun 21 10:34:42.985240 dv-cinder-836973-8-iscsi devstack@n-api.service[124162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 10:34:43.639939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 10:34:43.647043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 10:34:44.834594 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:34:44.834594 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: from cryptography.utils import int_from_bytes Jun 21 10:34:44.835415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:34:44.835415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: from cryptography.utils import int_from_bytes Jun 21 10:34:44.912252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:34:44.912252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: from cryptography.utils import int_from_bytes Jun 21 10:34:44.913518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:34:44.913518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: from cryptography.utils import int_from_bytes Jun 21 10:34:47.306695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:34:47.307353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:34:47.307498 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:34:47.307867 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:34:47.308142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:34:47.308540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.308861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.309253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.309524 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.309858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.310202 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.310536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.310854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.311188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.311452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.311772 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.312212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-8-iscsi {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.312428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.312736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.313268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.313385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.313673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.313998 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.314395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.314906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.316385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.316385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.316385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.316843 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.317039 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.317370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.317692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.318007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.318367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.318680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.319302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-8-iscsi {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.319787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.320284 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.320615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.321053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.321376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.321722 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.322113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.322445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.322765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.323301 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.323799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.324293 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.324806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.325107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.325449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.325895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.326261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.326738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.327121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.327332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.327589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.327954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.328438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.328595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.329029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.333775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.336533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.337752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.338906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.339704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.339704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.339983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.340122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.340405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.341123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.341123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.341440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.341589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.342084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.342282 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.342707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.342871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.343151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.343440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.343771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.344084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.344827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.344827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.345147 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.345327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.345628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.345937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.346295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.347120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.347120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.347449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.347720 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.348033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.348307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.348651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.348960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.349268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.349597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.349904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.350244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.350558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.351135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.351135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.351447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.351750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.352067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.352369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.352672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.353472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.353472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.353991 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.353991 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.354352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.354644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.355095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.355254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.355593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.355932 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.356280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.356600 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.356975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.357238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.357559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.357904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.358498 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.358832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.359252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.359573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.359898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.360207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.360545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.360880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.361512 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.361512 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.361834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.362152 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.362472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.362792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.363167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.363444 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.363919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.364142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.364438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.364778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.365208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.365407 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.365732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.366072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.366394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.366730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.367047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.367366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.367678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.367993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.368302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.368645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.368957 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.369597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.369597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.370044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.370388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.370721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.371027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.371327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.371724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.371948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.372253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.372562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.372879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.373167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.373544 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.373829 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.374196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.374505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.374924 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.375212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.375582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.375739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.376048 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.376366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.376680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.376986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.377325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.377642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.377950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.378313 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.379312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.379312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.379312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.379766 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.379905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.380165 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.380481 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.380807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.381129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.381537 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.382028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.382450 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.382450 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.383558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.383558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.383558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.384141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.384141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.384836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.384836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.385298 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.385602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.385954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.386150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.386354 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.386662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.386976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.387293 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.387606 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.387916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.388223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.388534 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.388884 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.389195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.389552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.389893 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.390260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.390588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.390905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.391225 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.391538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.392087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.392247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.392466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.392790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.393103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.393432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.393737 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.394081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.394399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.394724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.395056 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.395352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.395697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.396061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.396341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.396664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.396978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.397294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.397606 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.397918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.398256 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.398571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.398890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.399608 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.399608 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.399868 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.400197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.400521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.400832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.401138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.401458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.401793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.402156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.402472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.402785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.403109 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.403424 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.403736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.403903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:34:47.404329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.404408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:34:47.404496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.404672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.404773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:34:47.404965 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.405062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:34:47.405256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:34:47.405358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.405577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.405681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.405889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.406093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.406210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.406437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.406546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.406723 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.406819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.407048 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.407353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.407450 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.407737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.407940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.408085 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.408226 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.408374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.408530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.408716 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.408879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.409032 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.409216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.409387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-8-iscsi {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.409531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.409682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.409838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.409981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.410185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.410352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.410497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.410647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.410789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.410930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.411080 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.411247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.411399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.411543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.411686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.411840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.412010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.412175 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.412327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.412497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.412768 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.412917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.413069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.413069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.413347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.413495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.413656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.413808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.413959 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.414167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.414326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.414326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.414611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.414770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.414915 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.415057 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.415206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.415349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-8-iscsi {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.415558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.415884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.416035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.416035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.416313 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.416454 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.416606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.416782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.416937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.417079 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.417254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.417410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.417566 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.417709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.417868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.418011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.418200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.418398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.418551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.418710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.418861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.419042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.419190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.419342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.419496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.419638 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.419797 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.420089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.420238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.420393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.420534 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.420677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.420825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.420974 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.421117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.421273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.421415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.421563 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.421706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.421858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.422010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.422196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.422349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.422492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.422645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.422798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.422941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.423091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.423233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.423375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.423533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.423686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.423838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.423988 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.424138 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.424297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.424448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.424601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.424751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.424894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.425035 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.425186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.425370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.425526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.425668 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.425827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.426179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.426331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.426475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.426616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.426616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.426884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.427038 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.427181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.427181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.427465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.427619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.427767 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.427922 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.428064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.428205 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.428353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.428504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.428656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.428656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.428945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.429087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.429229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.429376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.429539 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.429689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.429831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.429972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.430133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.430281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.430444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.430590 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.430739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.430881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.431047 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.431232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.431401 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.431600 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.431962 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.432206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.432365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.432509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.432660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.432850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.433007 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.433158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.433301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.433562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.433721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.433721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.434020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.434223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.434410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.434572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.434723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.434875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.435025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.435177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.435326 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.435477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.435628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.435778 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.435936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.436245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.436400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.436558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.436701 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.436844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.436985 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.436985 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.437254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.437405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.437547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.437688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.437688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.437974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.438150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.438297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.438439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.438580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.438728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.438872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.439023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.439172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.439314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.439463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.439613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.439765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.439920 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.440072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.440223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.440576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.440576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.441056 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.441373 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.441684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.441993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.442335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.442663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.442986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.443298 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.443615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.443925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.444238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.444547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.444862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.445169 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.445487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.445783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.450416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.450674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.450858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.450858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.451180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.451328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.451328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.451328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.451328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.451905 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.452048 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.452201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.453322 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.453449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.453550 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.453637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.453730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.453730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.453894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.453976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.454178 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.454904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.455506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.455598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.455689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.455689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.455854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.455950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.455950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.455950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.456250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.456570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.456907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.456907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.457222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.457570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.457899 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.458479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.458636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.458902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.459037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.459220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.459411 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.459551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.459831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.459962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.460160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.460321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.460459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.460866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.461019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.461148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.461275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.461409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.461655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.461785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.461973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.462136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.462471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.462789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.462926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.463103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.463389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.463554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.463692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.463873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.464004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.464306 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.464452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.464709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.464869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.465008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.465264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:34:47.465395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.465641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.465821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.465951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.466286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.466418 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.466657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.466904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.467142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.467274 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.467536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.467666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.467846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468450 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.468971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.469109 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.469398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.469547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.469825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.469956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.470175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.470371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.470510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.470891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.471052 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.471309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.471462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.471603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.471758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.472934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473329 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.473929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474106 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474267 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.474865 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475157 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475607 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.475892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.476901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.477804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.478403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.478580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.478865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479024 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479748 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.479897 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480045 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480767 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.480918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.481877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482367 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482658 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.482938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.483987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484702 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.484996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.485875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.486928 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487077 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.487984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488434 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.488895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489215 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489392 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.489998 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.490287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.490443 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.490585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.490777 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.490933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491566 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.491987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492568 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.492998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.493986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.494982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495414 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495745 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.495971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.496067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.496304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.496416 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.496620 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.496716 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.497929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498275 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.498878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499777 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.499924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500341 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500622 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.500908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501059 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501677 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501845 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.501936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503596 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503911 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.503983 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504059 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504138 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.504916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505555 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505865 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.505955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506528 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.506964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507800 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.507897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508113 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508202 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508515 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.508847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.509048 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.509172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.509590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.509995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.509995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.510921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.511900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512104 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512242 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.512883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.513895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514650 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.514917 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515716 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.515891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.516890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517104 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517738 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.517820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518182 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.518974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519509 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.519960 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.520933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521137 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521556 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.521918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.522803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523104 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.523931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524539 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524679 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.524916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525447 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.525886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526026 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526758 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.526978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527289 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.527913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528010 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.528934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.529145 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.529247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.529462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.529559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.529771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530401 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.530821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531048 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.531946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532622 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.532936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533288 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.533901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.534919 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535128 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.535853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536054 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536754 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.536978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537608 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.537885 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.538959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539144 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.539857 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.540072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.540163 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.540399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.540606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.540899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541109 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.541826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542423 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542530 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542744 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.542843 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543192 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.543976 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544058 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.544914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.545848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546198 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.546800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547031 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547340 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547436 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.547740 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548345 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548568 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.548976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549288 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549493 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.549905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550279 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550566 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.550873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551194 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551720 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.551810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552321 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552720 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.552932 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553334 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553636 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.553933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.554881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555795 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.555999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.556121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.556401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.556499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.556704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.556822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557013 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.557968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558414 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.558913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559424 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559743 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559885 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.559985 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.560980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561220 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561322 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.561948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562608 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.562897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563116 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563213 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.563832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.564978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.565938 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566665 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.566990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567198 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567296 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.567913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568445 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.568852 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569069 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569385 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.569779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570658 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.570977 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.571929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572636 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.572989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:34:47.573248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.573559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.573871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.574212 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.574523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.574836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.575181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.575467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.575772 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.576187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.576497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.576886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.577120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.577426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.577729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.578041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.578384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.578697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.578997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.579302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.579627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.579930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.580251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.580670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.580981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.581308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.581708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.582020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.582354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.582678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.582999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.583690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.583996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.584312 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.584623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.584948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.585271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.585583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.585899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.586235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.586557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.586880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.587197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.587579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.587991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.588317 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.588648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.588956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.589318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.589628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.589936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.590353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.590589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.590902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.591226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.591535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.591853 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.592166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.592476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.592790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.593097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.593423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.593730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.594082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.594394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.594721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.595045 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.595354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.595679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.595992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.596313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.596605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.596909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.597261 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.597567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.597890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.598245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.598577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.598887 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.599225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.599555 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.599873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.600193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.600524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.600829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.601130 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.601441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.601749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.602069 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.602387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.602698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.603110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.603634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.604133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.604608 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.604929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.605263 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.605583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.605898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.606262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.606576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.606929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.607243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.607586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.607914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.608245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.608578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.608894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.609231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.609552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.609875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.610219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.610539 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.610861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.611177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.611495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.611806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.612123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.612442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.612762 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.613323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.613655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.613970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.614310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.614627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.614944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.615259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.615573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.615888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.616201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.616514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.616845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.617176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.617505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.617931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.618193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.618726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.619103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.619430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.619794 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.620111 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.620424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.620742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.621062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.621379 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.621697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.622013 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.622355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.622673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.623028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.623296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.623613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.623931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.624258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.624597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.624917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.625233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.625551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.625867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.626422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.626746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.627078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.627407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.627733 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.628053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.628374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.628706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.629016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.629328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.629640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.629951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.630426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.630760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.631079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.631388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.631711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.632025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.632557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.632923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.633236 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.633565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.633892 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.634357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.634567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.635314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.635314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.635508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.635794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Registered counter for database nova_api Jun 21 10:34:47.635904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.636105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.636413 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.636719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.637028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.637338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.637645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.637955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.638284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.638656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.638912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.639231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.639536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.639848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.640153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.640462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.640766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.641070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.641384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.641687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.641998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.642330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.642643 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.642949 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.643260 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.643622 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.643949 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.644256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.644561 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.644880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.645192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.645516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.645829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.646164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.646516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.646834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.647374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.647712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.648035 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.648369 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.648767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.649017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.649327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.649633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.650230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.650580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.650863 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.652902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.655632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.656290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.656290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.656290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.656517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.656732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.656845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.657100 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.657360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.657682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.657996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.658358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.658684 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.659259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.659500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.659816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.660291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.660446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.660763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.661120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.661430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.661752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.662096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.662423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.662798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.663096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.663418 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.663657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.663809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.664067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.664312 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.664603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.665025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.665258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.665813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.665927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.666265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.666568 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.666868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.667164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.667467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.667772 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.668072 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.668378 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.668680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.669020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.669291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.669589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.669899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.670244 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.670528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.670832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.671134 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.671439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.671774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.672109 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.672424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.672741 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.673055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.673374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.673738 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.673998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.674326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.674644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.674988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.675293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.675607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.675923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.676239 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.676552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.676863 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.677175 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.677506 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.677834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.678170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.678502 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.678833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.679154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.679473 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.679790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.680121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.680434 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.680746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.681112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.681426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.681737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.682069 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.682398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.682726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.683054 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.683366 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.683693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.684023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.684372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.684689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.685033 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.685363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.685680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.685995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.686330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:34:47.686575 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:34:47.720962 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.context [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),002ebcf0-7789-424b-b18d-3bf9b98012a2(cell1) {{(pid=124179) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 10:34:47.725095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:34:47.726729 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:34:47.727543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:34:47.729549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:34:47.731614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Registered counter for database nova_cell0 Jun 21 10:34:47.735665 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Registered counter for database nova_cell1 Jun 21 10:34:47.743057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.745952 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.749751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO dbcounter [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Registered counter for database nova_api Jun 21 10:34:47.753791 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.754107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.770401 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.777718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writer thread running {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.835152 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.context [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),002ebcf0-7789-424b-b18d-3bf9b98012a2(cell1) {{(pid=124180) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 10:34:47.839301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:34:47.840901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:34:47.841718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:34:47.843741 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:34:47.845783 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO dbcounter [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Registered counter for database nova_cell0 Jun 21 10:34:47.849915 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO dbcounter [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Registered counter for database nova_cell1 Jun 21 10:34:47.857555 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.859091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.866073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writer thread running {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.867415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writer thread running {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:47.900666 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO dbcounter [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Registered counter for database nova_cell0 Jun 21 10:34:47.907698 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_db.sqlalchemy.engines [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:47.912373 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writer thread running {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:48.019241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO dbcounter [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Registered counter for database nova_cell0 Jun 21 10:34:48.028169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:34:48.036494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writer thread running {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:34:48.230657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:34:48.238094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:34:48.354937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: WARNING keystonemiddleware.auth_token [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:34:48.362394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: WARNING keystonemiddleware.auth_token [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:34:48.584257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:34:48.591149 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: WARNING keystonemiddleware.auth_token [None req-a796fa2c-7720-458c-9b16-149dfc6557ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:34:48.596712 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3c57ff9c0 pid: 124179 (default app) Jun 21 10:34:48.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: WARNING keystonemiddleware.auth_token [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 10:34:48.715656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: WARNING keystonemiddleware.auth_token [None req-4e46be07-546d-4be8-884f-9bcbf7f82ff6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 10:34:48.721020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3c57ff9c0 pid: 124180 (default app) Jun 21 10:35:27.756886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.757561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.758610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.759448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.882685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d283aa9-055d-41a1-b324-03fed47eed85 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Action: 'create', calling method: .version_select at 0x7f8a37db5700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-259958080", "metadata": {"Type": "work"}}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:31.520387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4d283aa9-055d-41a1-b324-03fed47eed85 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.771122 Jun 21 10:35:31.521840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 21 10:35:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3774 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 10:35:32.077120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d7d19a1b-c9cd-403c-a336-c36e113faec4 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Calling method '.version_select at 0x7f8a37e69280>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:32.095231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.096955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.098115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.099118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:33.740384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d7d19a1b-c9cd-403c-a336-c36e113faec4 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231" status: 200 len: 353 microversion: 2.1 time: 2.208322 Jun 21 10:35:33.747799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:35:31 2022] GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 => generated 353 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:35:33.753886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-497bb6f9-7972-40c7-8d21-ecdaf4a928e0 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Calling method '.version_select at 0x7f8a37c7f550>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:34.067624 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-497bb6f9-7972-40c7-8d21-ecdaf4a928e0 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231" status: 200 len: 353 microversion: 2.1 time: 0.318297 Jun 21 10:35:34.068825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:35:33 2022] GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 => generated 353 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:35:34.086112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2fb3eeb4-5d0e-426a-8a21-fdfbd37dfba3 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Calling method '.version_select at 0x7f8a37cc15e0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:34.617895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2fb3eeb4-5d0e-426a-8a21-fdfbd37dfba3 tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231" status: 202 len: 0 microversion: 2.1 time: 0.534750 Jun 21 10:35:34.619593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:35:34 2022] DELETE /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:35:34.629156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b0552352-c70d-4427-98a2-8c646e2c310b tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Calling method '.version_select at 0x7f8a37c7f670>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:34.753737 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b0552352-c70d-4427-98a2-8c646e2c310b tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231" status: 200 len: 352 microversion: 2.1 time: 0.130249 Jun 21 10:35:34.754405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:35:34 2022] GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:35:35.768560 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4ecd06ef-5f88-43f9-906c-fd4ec451f3ef tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Calling method '.version_select at 0x7f8a37cc1670>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:36.788555 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-4ecd06ef-5f88-43f9-906c-fd4ec451f3ef tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] HTTP exception thrown: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4ecd06ef-5f88-43f9-906c-fd4ec451f3ef tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Request method failure captured: Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 HTTP/1.1 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ7vBB-ARsKFqqIbezuMrwgdSbXlYL2hzidycN4pcCNE85Essk9KlyYbDlGArZGUjpRdl5FeHebcScPde8CYuqjcZ4oJv7m1U5vl1htk2AmwjxMmb79bJjgH7Q56Za9KYdBV1miTab4CXcLXtzdxvzl6HFSBqjRWFNknUAzBEF3Z9TY Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: ddd2066e6b9c4fa5bee1dd70417db2f9 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesGetTestJSON-112906950 Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:35:36.797403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddd2066e6b9c4fa5bee1dd70417db2f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ddd2066e6b9c4fa5bee1dd70417db2f9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ddd2066e6b9c4fa5bee1dd70417db2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ddd2066e6b9c4fa5bee1dd70417db2f9"}]}] Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesGetTestJSON-112906950 Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: ddd2066e6b9c4fa5bee1dd70417db2f9 Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesGetTestJSON-112906950 Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesGetTestJSON-112906950-project Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 5a6c082a2ccf4273bc98df8e0e6e99be Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesGetTestJSON-112906950-project Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '2c600ca9-fe9a-456d-a079-276381ae6231'} Jun 21 10:35:36.798675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. (HTTP 404) (Request-ID: req-1e009de6-580f-4853-8670-cd7831592b97) Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:35:36.799546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:35:36.800644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:35:36.801709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. Jun 21 10:35:36.802876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:35:36.806422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4ecd06ef-5f88-43f9-906c-fd4ec451f3ef tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] Returning 404 to user: Volume 2c600ca9-fe9a-456d-a079-276381ae6231 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:35:36.817569 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4ecd06ef-5f88-43f9-906c-fd4ec451f3ef tempest-VolumesGetTestJSON-112906950 tempest-VolumesGetTestJSON-112906950-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231" status: 404 len: 109 microversion: 2.1 time: 1.044948 Jun 21 10:35:36.821870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:35:35 2022] GET /compute/v2.1/os-volumes/2c600ca9-fe9a-456d-a079-276381ae6231 => generated 109 bytes in 1058 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:35:40.039304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-76b44971-e95c-42ba-b473-1dbfa32cbdb4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: .version_select at 0x7f8a37c7fc10>, body: {"keypair": {"name": "tempest-keypair-848821487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoRu3pXDjmWVNVrRP84qbUctNM6aAU+78f+0VMtlIXc8IFLMdrK/o+RA3qjOVkRuDQDmbG6szYD2x94FKZ/K4Bb8pMQjJ4/C3e3nUf7DsjDM7H5BzMYRDfxXkdt9IkBPQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:40.147943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-76b44971-e95c-42ba-b473-1dbfa32cbdb4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:35:40.167416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-76b44971-e95c-42ba-b473-1dbfa32cbdb4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for user f58d6e222d654e66b38fcefeff65fe80 and project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:35:40.262463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-76b44971-e95c-42ba-b473-1dbfa32cbdb4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.315119 Jun 21 10:35:40.265658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 4/7] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:35:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:35:43.800307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-533553803", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:44.105250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] validate_networks() for [('b5c66912-fa70-4c1c-9c81-671c5faa702c', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:35:46.561634 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1370125414", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "networks": [{"uuid": "bb681f07-b557-4eba-9ae2-5ce444664106"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:46.708813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:35:46.709405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:35:46.709962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:35:46.710706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:35:46.710981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:35:46.762732 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:46.764107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:46.765709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:46.766177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:46.889257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] validate_networks() for [('bb681f07-b557-4eba-9ae2-5ce444664106', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:35:46.962961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:35:46.974042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for user 9bbb5d4487874bdd9f82e28651a418f9 and project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:35:46.991039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:35:46.995302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:35:47.244986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e9754587-5af0-41f5-99ab-7f45abc3ca96 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.727126 Jun 21 10:35:47.245636 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 4/8] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:35:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:35:47.274349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-895218276", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58abac2a-7802-4e63-8ffd-5ef6d3410d2e"}], "security_groups": [{"name": "tempest-securitygroup--1310682908"}], "key_name": "tempest-keypair-848821487", "user_data": "}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:47.542672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] validate_networks() for [('58abac2a-7802-4e63-8ffd-5ef6d3410d2e', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:35:48.420603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:35:48.422403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:35:48.428923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:35:48.429776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:35:48.430505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:35:48.441844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:48.442602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:48.443585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:48.444336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:48.487237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:35:48.492903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for user f58d6e222d654e66b38fcefeff65fe80 and project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:35:48.508625 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:35:48.512030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:35:48.643418 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cc547b67-a89d-47ef-9893-4722f177602e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.390744 Jun 21 10:35:48.645088 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 5/9] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:35:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:35:48.652507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0dfe00cc-ce96-49f9-b866-319bf3df8f3f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:48.653497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0dfe00cc-ce96-49f9-b866-319bf3df8f3f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:48.872605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0dfe00cc-ce96-49f9-b866-319bf3df8f3f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:48.921488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0dfe00cc-ce96-49f9-b866-319bf3df8f3f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1221 microversion: 2.1 time: 0.273083 Jun 21 10:35:48.922406 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:48 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:48.938501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9dc6a707-5cd3-4c09-8f02-e1e5aa6c86a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:48.939058 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9dc6a707-5cd3-4c09-8f02-e1e5aa6c86a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:49.101396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9dc6a707-5cd3-4c09-8f02-e1e5aa6c86a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:49.111861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9dc6a707-5cd3-4c09-8f02-e1e5aa6c86a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1236 microversion: 2.1 time: 0.186030 Jun 21 10:35:49.113736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:48 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1236 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:49.175311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921379450", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:35:49.287769 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] validate_networks() for [('b5c66912-fa70-4c1c-9c81-671c5faa702c', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:35:49.796192 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:35:49.796792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:35:49.797134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:35:49.797594 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:35:49.798204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:35:49.836554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:49.838692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:49.839908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:49.841208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:49.953620 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Getting quotas for project b76f6f1219f94a24b5015fb819a67ed6. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:35:49.996464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Getting quotas for user 5a3a6c87dbcb41eba4597f8a16651ecc and project b76f6f1219f94a24b5015fb819a67ed6. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:35:50.070996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:35:50.093575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:35:50.389792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8d176257-1111-463c-8fd0-26b9e00228d4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.389436 Jun 21 10:35:50.392129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 5/12] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:35:50.403544 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7b252243-c17e-44f1-b273-d353f05fbdd2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:50.404927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7b252243-c17e-44f1-b273-d353f05fbdd2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:50.767103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7b252243-c17e-44f1-b273-d353f05fbdd2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:50.808927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7b252243-c17e-44f1-b273-d353f05fbdd2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1236 microversion: 2.1 time: 0.414950 Jun 21 10:35:50.815027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 6/13] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:50 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1236 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:50.823633 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-416cd803-e70f-4c8e-9e6c-1b6689afc6ce tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:50.827688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-416cd803-e70f-4c8e-9e6c-1b6689afc6ce tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:50.865186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:35:50.865810 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:35:50.866457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:35:50.867101 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:35:50.867762 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:35:50.879693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:50.880398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:50.881429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:50.882115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:50.915204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:35:50.920717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for user 9bbb5d4487874bdd9f82e28651a418f9 and project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:35:50.949652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:35:50.952362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:35:50.997168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-416cd803-e70f-4c8e-9e6c-1b6689afc6ce tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:51.007778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-416cd803-e70f-4c8e-9e6c-1b6689afc6ce tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1215 microversion: 2.1 time: 0.191295 Jun 21 10:35:51.012531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:50 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:51.077798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dffc60e9-b06f-4c61-9a2c-0bea0f35ffac tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.906065 Jun 21 10:35:51.078323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 8/15] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:35:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:35:51.090387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a6b504f-40f7-4424-b216-46a325af7915 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:51.090492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a6b504f-40f7-4424-b216-46a325af7915 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:51.276969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a6b504f-40f7-4424-b216-46a325af7915 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:51.287963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a6b504f-40f7-4424-b216-46a325af7915 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1221 microversion: 2.1 time: 0.201403 Jun 21 10:35:51.289378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:51 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:51.835053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:51.838180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:51.868495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:51.869775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:51.870974 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:51.872710 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:52.030148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:52.030978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:52.051839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:52.061752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:52.065447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:52.074913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:52.656423 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:52.701112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4b74a625-6bc2-43ef-91d7-3da7870563cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1219 microversion: 2.1 time: 0.675492 Jun 21 10:35:52.714386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:52 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1219 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:35:52.721248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:52.726649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:52.747207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:52.747694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:52.750704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:52.751125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:52.771109 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:52.807847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-95df4871-cbc3-4edd-8450-3e5606fee5ec tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1232 microversion: 2.1 time: 0.977195 Jun 21 10:35:52.818036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:51 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1232 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:52.992457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:53.001231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-857d79d7-dd8b-4c63-90a0-8ef084dbb0fe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1217 microversion: 2.1 time: 0.285251 Jun 21 10:35:53.001854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 10/19] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:52 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1217 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:53.720252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:53.720837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:53.729766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:53.730256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:53.735643 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:53.736449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:53.836946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:53.837552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:53.848475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:53.848934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:53.849712 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:53.850168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:54.062559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:54.078416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7d3aab25-f474-4bb7-8a8a-32beec833b3c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1294 microversion: 2.1 time: 0.245766 Jun 21 10:35:54.081988 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:53 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:54.095176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:54.100025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:54.128520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:54.130215 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:54.131058 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:54.136734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:54.390571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:54.404515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6a6504b5-92aa-41ef-a898-5e5ecf5a85cb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1267 microversion: 2.1 time: 0.685810 Jun 21 10:35:54.406597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 10/21] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:53 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1267 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:54.954172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:54.974173 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-688adddb-2ce1-4b6e-9ca2-6be57ead78d3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1273 microversion: 2.1 time: 0.889647 Jun 21 10:35:54.980723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 12/22] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:54 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1273 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:55.100593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:55.101420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:55.115240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:55.118472 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:55.119811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:55.121067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:55.437295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:55.438415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:55.452071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:55.457432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:55.459139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:55.460733 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:55.702852 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:55.725499 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ba978ffb-ab68-418c-a2a2-a00ee6ecd214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1273 microversion: 2.1 time: 0.305711 Jun 21 10:35:55.738908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 13/23] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:55 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:35:55.993193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:55.994083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:56.037271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:56.051258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-801539af-fcbb-4a45-8f94-2ca7ba830fcb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1294 microversion: 2.1 time: 0.955203 Jun 21 10:35:56.052348 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:56.054429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:56.058608 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:55 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1294 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:56.068584 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:56.082123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:56.744649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:56.745874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:56.763188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:56.763794 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:56.771327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:56.771930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:56.994774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:57.021170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c83ad927-fddc-49cc-9c62-e46fb53d6fbe tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1273 microversion: 2.1 time: 0.264329 Jun 21 10:35:57.023945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:56 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:35:57.077565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:57.082750 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:57.099616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:57.103153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:57.105320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:57.107755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:57.321643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:57.340248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-06d0bf21-a0b2-4c4a-8181-6655268456ad tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1279 microversion: 2.1 time: 1.349723 Jun 21 10:35:57.342223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:55 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1279 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:57.447549 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:57.499471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-30323bba-687b-4a87-ab3a-f27b15f3206c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1294 microversion: 2.1 time: 0.425447 Jun 21 10:35:57.503860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:57 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1294 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:58.041826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:58.042941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:58.071461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.072807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.080973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.086680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.359204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:58.359832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:58.372095 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.372801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.373841 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.377485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.405355 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:58.417630 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4b4d7c97-a699-4196-863b-3d87ab73b1ea tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1273 microversion: 2.1 time: 0.378494 Jun 21 10:35:58.418235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:58 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:58.521567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:58.522221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:58.536795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.537258 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.538039 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:58.547122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:58.744289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:58.758111 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:58.758748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ca9c652e-bc9d-4a86-ad90-3527ee832e33 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1294 microversion: 2.1 time: 0.241749 Jun 21 10:35:58.759449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:58 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:35:58.768158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c0a78d52-cfe4-42d4-9aee-d519326db767 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1279 microversion: 2.1 time: 0.412971 Jun 21 10:35:58.804126 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 14/30] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:58 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1279 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:59.435324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:59.435987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:59.448685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.449132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.450105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.451727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.697346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:35:59.705931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cc8a16b7-dbf4-43cf-82d8-cbfe6d1f5da2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1273 microversion: 2.1 time: 0.274976 Jun 21 10:35:59.722569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:59 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:35:59.777397 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:59.778008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:59.796645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.797128 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.797970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.798433 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.802676 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:35:59.803667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:35:59.815672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.816543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.830283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:35:59.840207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:35:59.955102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:00.009653 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:00.020168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-73c7aafd-0fd4-45cf-96af-cca14d5f6900 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1294 microversion: 2.1 time: 0.244917 Jun 21 10:36:00.022768 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:59 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:00.064867 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:00.082981 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5da7b0dc-2513-46bd-916f-27dccc8838fa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1279 microversion: 2.1 time: 0.284913 Jun 21 10:36:00.087147 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:35:59 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:00.725278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:00.726288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:00.749439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:00.750189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:00.751130 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:00.753554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:00.900616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:00.937770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=22 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:01.040196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:01.040778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:01.046477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:01.064725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:01.067750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:01.073220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:01.075323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:01.082829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-10586837-7c12-4ef7-b21f-228da2e7a311 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1273 microversion: 2.1 time: 0.361262 Jun 21 10:36:01.095226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 16/34] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:00 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1273 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:01.123035 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:01.123797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:01.150402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:01.156062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:01.158286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:01.161211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:01.282030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=16 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:01.417396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:01.433954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-91d3ad25-0e8c-4c29-b8e8-f888117e6637 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1279 microversion: 2.1 time: 0.333253 Jun 21 10:36:01.450667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 17/35] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:01 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1279 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:01.550865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:01.559158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50eb073f-53c6-4a4a-a6f6-7cf59e500d73 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.523306 Jun 21 10:36:01.570982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:01 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:02.111300 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:02.112909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:02.129798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:02.138309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:02.141459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:02.141901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:02.457249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:02.458112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:02.475260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:02.475858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:02.476919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:02.477476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:03.645673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:03.659969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bf3e4362-1332-46a9-928a-39608dbf8736 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 1.206771 Jun 21 10:36:03.677423 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:02 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:03.683430 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:03.690787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:03.716076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:03.717315 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:03.718523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:03.719273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:03.776973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:03.796193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8029bca7-fb90-40fc-8a48-246ad2a561bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 1.689702 Jun 21 10:36:03.807047 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 18/38] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:02 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:04.519290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:04.552451 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-29ec6356-014d-4171-a3f0-5f91e2ac49fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.872810 Jun 21 10:36:04.555451 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 21/39] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:03 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:04.702259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:04.708603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:04.742461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:04.746209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:04.750091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:04.753709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:04.820732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:04.821944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:04.869022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:04.873632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:04.883795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:04.884726 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:05.799994 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:05.818000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-13e13bd3-4374-4210-946c-40b6448c2445 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.996919 Jun 21 10:36:05.821256 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 22/40] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:04 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:05.952408 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-99c7b6e6-78b3-42f6-bf7d-035d869e8572 req-b9a9af4c-fbdd-460a-a18b-ce6dff894b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6ee216-79c8-4e70-b987-7cab0f5c5dd7", "tag": "14c5f777-8428-430b-a5a7-e316b6105b4b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:05.982539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-99c7b6e6-78b3-42f6-bf7d-035d869e8572 req-b9a9af4c-fbdd-460a-a18b-ce6dff894b4f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:05.984223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-99c7b6e6-78b3-42f6-bf7d-035d869e8572 req-b9a9af4c-fbdd-460a-a18b-ce6dff894b4f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.045042 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-99c7b6e6-78b3-42f6-bf7d-035d869e8572 req-b9a9af4c-fbdd-460a-a18b-ce6dff894b4f service nova] Creating event network-changed:14c5f777-8428-430b-a5a7-e316b6105b4b for instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 on hv-cinder-83697 Jun 21 10:36:06.050291 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-99c7b6e6-78b3-42f6-bf7d-035d869e8572 req-b9a9af4c-fbdd-460a-a18b-ce6dff894b4f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 10:36:06.053836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.057089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.059840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.061872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.093144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.compute.rpcapi [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 10:36:06.098024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] Releasing lock "compute-rpcapi-router" {{(pid=124179) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 10:36:06.137570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bf72aef2-0771-4773-a781-b05034ea5b16 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314875 Jun 21 10:36:06.138697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 23/41] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:36:06.146538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:06.149851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:06.166538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.167904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.170140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.173601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.241890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:06.279034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b4a1cd77-156d-435f-aa23-cd71ab2c8522 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 1.584267 Jun 21 10:36:06.279808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 19/42] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:04 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:06.837400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:06.838583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:06.878728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.879361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:06.885938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:06.887149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:07.010919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:07.046943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-56853f4c-40fe-4f11-876f-fe6d22a10d4a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.892165 Jun 21 10:36:07.047959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 24/43] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:06 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:07.297791 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:07.299122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:07.324546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:07.326939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:07.328071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:07.328770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:07.393950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:07.542658 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:07.554164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a8dbaab5-f804-45a8-8e50-455aabf62b0e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.722589 Jun 21 10:36:07.567241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 20/44] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:06 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:07.989238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:08.011177 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2ce27f66-a206-4cd0-b875-c180c71e5b4f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.718186 Jun 21 10:36:08.011884 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 25/45] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:07 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:08.068460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:08.069211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:08.098476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:08.098942 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:08.101838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:08.105093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:08.576653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:08.577773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:08.588530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:08.589668 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:08.591511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:08.592280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:08.822163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:08.835750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-822fc723-981f-491a-83df-67f68704a460 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.257111 Jun 21 10:36:08.837361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 26/46] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:08 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:08.849588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:08.866372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-54b01d97-f409-4adf-94c2-2d48d54f3002 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.801403 Jun 21 10:36:08.870237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 21/47] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:08 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:09.029607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:09.030747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:09.045468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.046302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.047296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.047922 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.226868 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-a01195a7-974f-4c01-bc56-cd68c7aedb2d req-ace56d62-f3d9-41cd-875c-571945d210bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41dcf0af-2c3f-40a6-82a7-86f4be479e9e", "tag": "b7baf3ca-b0e6-48a9-976e-a9d0f3332f16"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:09.231734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.243077 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a01195a7-974f-4c01-bc56-cd68c7aedb2d req-ace56d62-f3d9-41cd-875c-571945d210bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.243571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a01195a7-974f-4c01-bc56-cd68c7aedb2d req-ace56d62-f3d9-41cd-875c-571945d210bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.268626 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-a01195a7-974f-4c01-bc56-cd68c7aedb2d req-ace56d62-f3d9-41cd-875c-571945d210bf service nova] Creating event network-changed:b7baf3ca-b0e6-48a9-976e-a9d0f3332f16 for instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e on hv-cinder-83697 Jun 21 10:36:09.276992 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-a01195a7-974f-4c01-bc56-cd68c7aedb2d req-ace56d62-f3d9-41cd-875c-571945d210bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287353 Jun 21 10:36:09.278168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 27/48] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:36:09.312142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:09.321014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-84fbb482-b375-4670-a111-863aa183fc9d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.295816 Jun 21 10:36:09.321604 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 22/49] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:09 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:09.854622 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:09.855796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:09.866225 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.867161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.868641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.869043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.889269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:09.890082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:09.905262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.907958 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:09.909133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:09.909615 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:10.144809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:10.155538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-00ba504e-89f4-40c9-8e95-1ff94ee49b89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.272599 Jun 21 10:36:10.165859 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 23/50] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:09 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:10.190011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:10.206642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-59c5ad09-48e3-402f-be5a-ced86bbe96b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.354752 Jun 21 10:36:10.213750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 28/51] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:09 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:10.343943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:10.347166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:10.360287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:10.360745 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:10.361548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:10.361974 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:10.384404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:10.566840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:10.579949 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a3f650f7-b1ac-44de-9135-fc2b6548107b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.244066 Jun 21 10:36:10.580687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 24/52] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:10 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:11.173505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:11.174347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:11.183613 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.187006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.188349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.188954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.222252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:11.223543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:11.234766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.236251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.237431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.238287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.378741 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:11.390960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c40336c9-0ee3-4c12-97e1-e08ea47a1dfa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.220706 Jun 21 10:36:11.395533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 29/53] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:11 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:11.405780 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27ba21f-6661-4761-8ee2-b0c85ba56fad", "tag": "ce8496d1-3043-4a28-b9ce-bc6b3d0176fc"}, {"name": "network-changed", "server_uuid": "59895c2d-27a0-4bbb-8fad-a6512041d87f", "tag": "b79d70d7-f715-4336-a3e6-dcaf0e33ceb0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:11.423520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.424142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.439615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] Creating event network-changed:ce8496d1-3043-4a28-b9ce-bc6b3d0176fc for instance b27ba21f-6661-4761-8ee2-b0c85ba56fad on hv-cinder-83697 Jun 21 10:36:11.440118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] Creating event network-changed:b79d70d7-f715-4336-a3e6-dcaf0e33ceb0 for instance 59895c2d-27a0-4bbb-8fad-a6512041d87f on hv-cinder-83697 Jun 21 10:36:11.450358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:11.450825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-3cc416a0-33de-491d-ac2f-f1873c167704 req-99dbc423-3d12-4e46-af9c-f4c5201b1648 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053019 Jun 21 10:36:11.451480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 30/54] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:36:11.458825 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8964538f-c30d-4d3c-946d-514edbdd1b12 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.241553 Jun 21 10:36:11.459398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 25/55] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:11 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:11.606690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:11.607388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:11.613902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.614376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.615138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:11.615568 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:11.765771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:11.775114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b8446532-7d33-4f63-a79f-c2164dc14266 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.173901 Jun 21 10:36:11.775721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 31/56] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:11 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:12.410351 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:12.411489 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:12.417357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.417798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.418591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.419015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.477768 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:12.477768 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:12.483773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.484041 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.485054 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.485757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.584117 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:12.594016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5d0e9e58-2022-485a-afe0-b59b9fb1e80e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.187622 Jun 21 10:36:12.595022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 26/57] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:12 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:12.648014 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:12.656396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ad91dba2-7258-44c0-b6ac-9ef48878bcaf tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.184040 Jun 21 10:36:12.657451 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 32/58] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:12 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:12.792450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:12.793063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:12.799464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.799908 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.800673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:12.801102 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:12.944688 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:12.953406 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bc607260-c084-46ae-933b-5845fb4500f0 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.165105 Jun 21 10:36:12.954015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:12 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:13.611721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:13.612520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:13.624829 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.625567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:13.627110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.630518 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:13.674074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:13.674534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:13.680403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:13.700930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.701932 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:13.702200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.702714 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:13.914118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:13.926731 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e51bb843-3812-4349-a693-3281b213cc5d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.256474 Jun 21 10:36:13.927856 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 28/60] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:13 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:13.972074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:13.973061 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:13.981207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.981876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:13.983121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:13.983743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:14.027520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:14.036509 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a8627ef-cb33-410b-b305-05b4096f3f92 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.428999 Jun 21 10:36:14.037899 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 33/61] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:13 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:14.170926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:14.181007 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-02d7d5e6-5649-4df0-966d-5c5e6db8aa7f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.212908 Jun 21 10:36:14.191217 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 29/62] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:13 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:14.945124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:14.945807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:14.953658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:14.954151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:14.954958 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:14.955403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:15.056376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:15.057428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:15.067540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:15.068202 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:15.069227 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:15.069770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:15.143151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:15.160252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-472216ad-adfd-44a6-be69-de61d4df199d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.219914 Jun 21 10:36:15.172706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:14 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:15.199749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:15.200374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:15.207928 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:15.208390 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:15.209289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:15.209747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:15.290150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:15.301985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d7d57755-4852-4df8-96f3-1696b428fd61 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.252151 Jun 21 10:36:15.303547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 30/64] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:15 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:15.411200 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:15.425214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6005471c-ffd5-4daa-86c5-ebf995b07878 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.229424 Jun 21 10:36:15.426269 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 35/65] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:15 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:16.180755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:16.182310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:16.189788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.190485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.191417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.192004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.323314 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:16.324074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:16.327121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:16.331472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.331912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.332680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.333114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.341802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:16.349678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8ad55055-21fc-40ec-a04d-b271941e200a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.173533 Jun 21 10:36:16.350409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 31/66] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:16 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:16.444621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:16.445464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:16.451929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.452593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.453532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:16.454136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:16.540032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:16.550720 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d23732d0-c260-4471-bab9-7e419faac3a4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.233232 Jun 21 10:36:16.551317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 36/67] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:16 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:16.616712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:16.624633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3fcc6ce7-6a1a-4d0e-a04b-208964943538 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.183789 Jun 21 10:36:16.625207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 32/68] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:16 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:17.369662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:17.370406 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:17.379560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.380056 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.381138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.381873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.528771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:17.536751 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-91080a94-6442-42d7-8a67-f4beba43d89b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.173699 Jun 21 10:36:17.537505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 37/69] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:17 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:17.568042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:17.568654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:17.574918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.575836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.576612 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.577079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.641028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:17.641637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:17.650484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.650934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.651734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:17.652167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:17.738575 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:17.748300 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d20895f7-85b2-43dc-b046-7fac03e70306 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.183339 Jun 21 10:36:17.749174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 33/70] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:17 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:17.831549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:17.839522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9bffb448-3b8c-4381-b61a-3dd3aa573993 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.202265 Jun 21 10:36:17.840102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 38/71] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:17 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:18.555309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:18.555932 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:18.562188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.562639 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.563424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.563879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.723448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:18.738162 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-18154b7d-6825-424b-86a0-4dd191c44ef6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.186686 Jun 21 10:36:18.739185 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 34/72] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:18 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:18.765543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:18.766290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:18.773040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.773499 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.774318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.774756 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.858253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:18.858875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:18.865443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.866258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.867599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:18.868325 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:18.955045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:18.968186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6c0f5ff6-8a7f-495a-8aee-879490b58c3f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.206378 Jun 21 10:36:18.969212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 39/73] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:18 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:19.032318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:19.040347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3f20ea31-48a7-4eb5-8868-f327f22b9833 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.185963 Jun 21 10:36:19.041053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 35/74] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:18 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:19.763399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:19.764003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:19.771265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:19.771981 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:19.772521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:19.773201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:19.925302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:19.933388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a73d4e22-0c35-4147-ba1b-9a85f033b1b7 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.174083 Jun 21 10:36:19.933988 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 40/75] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:19 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:19.986169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:19.986848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:19.994531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:19.994978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:19.995899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:19.996497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:20.058881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:20.059506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:20.068892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:20.069353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:20.070163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:20.070611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:20.183625 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:20.202896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c985c370-095b-4800-9cbc-b675b7c4608a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.220566 Jun 21 10:36:20.203551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 36/76] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:19 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:20.305274 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:20.319189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1619f990-977e-4b33-9a56-6ad9674fb24b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.264660 Jun 21 10:36:20.321263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 41/77] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:20 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:20.953264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:20.953806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:20.961041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:20.961442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:20.962281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:20.962713 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:21.104659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:21.113521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-feb17533-19c0-4ae8-acbc-e1c2cf6ef508 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.164214 Jun 21 10:36:21.114208 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 37/78] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:20 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:21.221358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:21.221936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:21.229012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:21.229470 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:21.230293 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:21.230743 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:21.344689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:21.345672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:21.354810 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:21.355255 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:21.357163 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:21.358297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:21.390601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:21.403013 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a8fe20d9-1ad1-4020-8a69-0d74a953c16e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.185249 Jun 21 10:36:21.404032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 42/79] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:21 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:21.514536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:21.522577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2f0f88a8-ae03-45f0-a863-c5a9ea0b6d71 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.182445 Jun 21 10:36:21.523307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:21 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:22.131154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:22.131672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:22.138467 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.138924 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.139693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.140133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.159892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:22.289203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:22.297967 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-12488389-12f1-48e9-abe1-f624a5df85fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.170885 Jun 21 10:36:22.298700 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 43/81] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:22 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:22.420753 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:22.421412 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:22.427647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.428082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.428853 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.429282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.539822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:22.540440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:22.546817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.547266 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.548267 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:22.548703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:22.570991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:22.579869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d5ea7bc5-a709-4c7c-a5d6-dbbb50ed134b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.162945 Jun 21 10:36:22.580440 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 39/82] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:22 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:22.688658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:22.696988 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8d510695-4d2d-4027-9864-64001a4e4aff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.160740 Jun 21 10:36:22.697463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:22 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:23.316247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:23.316866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:23.326481 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.326933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.327733 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.328165 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.481829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:23.489482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-49e3d495-0e14-4697-a279-717bd802be5c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.177310 Jun 21 10:36:23.490079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:23 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:23.596890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:23.597475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:23.604125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.604591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.605355 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.605790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.715956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:23.716551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:23.723461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.723874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.724646 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:23.725058 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:23.730004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:23.743504 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:23.753425 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-21f5a2c2-8342-46f8-865f-e516f7dbcc85 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160340 Jun 21 10:36:23.754012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 45/85] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:23 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:23.873265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:23.879991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-368a1f9a-fa65-4597-8ef3-195d14ba2c38 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.168978 Jun 21 10:36:23.880562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 41/86] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:23 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:24.506839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:24.507996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:24.514650 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.515102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.515871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.516309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.657886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:24.666365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-57c5d295-e41b-4f30-bb25-ed9a477c054b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.163462 Jun 21 10:36:24.666936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 46/87] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:24 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:24.771022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:24.771614 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:24.779522 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.780045 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.780848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.781419 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.897039 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:24.897592 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:24.904341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.904880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.905783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:24.906631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:24.919465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:24.927627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8e777c90-a4ec-4242-a4d7-6b1a5cbc0a0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160425 Jun 21 10:36:24.928428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 42/88] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:24 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:25.049339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:25.057808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4bac8d36-90dc-453c-9cce-c441dd8478d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.164699 Jun 21 10:36:25.058438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 47/89] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:24 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:25.684064 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:25.684659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:25.692890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:25.693334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:25.694084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:25.694600 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:25.871909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:25.884310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a6075259-e2e3-46de-ae34-363fe096af96 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.204233 Jun 21 10:36:25.885292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 43/90] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:25 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:25.948493 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:25.949174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:25.957866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:25.958375 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:25.959187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:25.959631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:26.075067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:26.076191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:26.083440 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:26.084429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:26.085264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:26.086031 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:26.152167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:26.170917 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5e70510f-308a-4da0-bff3-50218f5402fa tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.228927 Jun 21 10:36:26.182389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:25 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:26.749140 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:26.765022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-77e1255d-0713-41bd-bc32-7b3bf17a88e9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.693959 Jun 21 10:36:26.779715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 44/92] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:26 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:26.901937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:26.902601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:26.909108 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:26.911020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:26.912395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:26.912892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.072825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:27.088933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d354f3f7-f71e-4c8e-8f2e-3e510e09a47a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.191482 Jun 21 10:36:27.089516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 49/93] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:26 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:27.190233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:27.190848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:27.197728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:27.198655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.199718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:27.200219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.377884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:27.386534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3b6f7631-1520-4268-9fdf-67f6d9458f0c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.200036 Jun 21 10:36:27.387373 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:27 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:27.489777 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-654f6ce4-8882-4525-b660-e12f5170b8cc req-60c604ee-36e8-4f81-b6f9-44e0a66c453d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6ee216-79c8-4e70-b987-7cab0f5c5dd7", "name": "network-vif-plugged", "status": "completed", "tag": "14c5f777-8428-430b-a5a7-e316b6105b4b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:27.499116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-654f6ce4-8882-4525-b660-e12f5170b8cc req-60c604ee-36e8-4f81-b6f9-44e0a66c453d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:27.499527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-654f6ce4-8882-4525-b660-e12f5170b8cc req-60c604ee-36e8-4f81-b6f9-44e0a66c453d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.511209 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-654f6ce4-8882-4525-b660-e12f5170b8cc req-60c604ee-36e8-4f81-b6f9-44e0a66c453d service nova] Creating event network-vif-plugged:14c5f777-8428-430b-a5a7-e316b6105b4b for instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 on hv-cinder-83697 Jun 21 10:36:27.516414 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-654f6ce4-8882-4525-b660-e12f5170b8cc req-60c604ee-36e8-4f81-b6f9-44e0a66c453d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091126 Jun 21 10:36:27.516990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 50/95] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:36:27.796431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:27.797217 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:27.803576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:27.806771 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.807559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:27.807988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:27.978174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:27.986663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-28cf8323-36e7-40de-81c3-1fae259865b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.194101 Jun 21 10:36:27.987958 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 46/96] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:27 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:28.107133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:28.115650 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:28.127253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:28.127641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:28.128951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:28.129395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:28.323828 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:28.332068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6eddaabe-ce50-45d0-8555-c54a11ff6afb tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.230225 Jun 21 10:36:28.332653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 51/97] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:28 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:28.404714 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:28.405435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:28.411801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:28.412241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:28.413010 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:28.413442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:28.633986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:28.642501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cf1d42f5-8d0e-4afd-ac17-9139c0daa4e5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.241974 Jun 21 10:36:28.643246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 47/98] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:28 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:29.008167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:29.008986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:29.028554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.030287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.032160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.033827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.186857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:29.203452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-81b45f54-dbf4-4601-9220-ac16215642c1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.195241 Jun 21 10:36:29.204309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 52/99] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:28 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:29.363199 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:29.363823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:29.386690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.387135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.388092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.388671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.631558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:29.640559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6c77486f-338a-4136-89a5-0c162c0675e5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.294947 Jun 21 10:36:29.641746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 48/100] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:29 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:29.669020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:29.669689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:29.681718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.686697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.692338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:29.693027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:29.864318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:29.879804 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bcd97e6e-0061-47df-8649-95cb43c2f14b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.222604 Jun 21 10:36:29.880404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 53/101] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:29 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:30.221499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:30.222130 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:30.229515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.230082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:30.230874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.231292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:30.419504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:30.434149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-aeddd7a1-b64d-43b8-aed1-4422d002d5eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.211067 Jun 21 10:36:30.444146 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 49/102] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:30 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:30.658725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:30.659338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:30.666092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.666539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:30.667393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.667814 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:30.817278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:30.825860 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ebe218b5-3d7c-4a24-9718-c9ac1c7487f5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.171062 Jun 21 10:36:30.826468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 54/103] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:30 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:30.897538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:30.898160 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:30.905578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.906019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:30.906817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:30.907290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:31.085523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:31.094230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-55a1be6e-53e0-44eb-a6b6-acf31ae79e89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.200281 Jun 21 10:36:31.094819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 50/104] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:30 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:31.452312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:31.453265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:31.460785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:31.461745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:31.463017 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:31.463486 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:31.628649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:31.637270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-948c7de2-99e2-429c-ae0b-0cd6c7d9f482 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.189579 Jun 21 10:36:31.637713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 55/105] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:31 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:31.843301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:31.843921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:31.850232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:31.850669 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:31.851414 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:31.851880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:31.995676 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:32.004326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ef156b8f-9484-4b3d-b8ea-4c0aaacb4122 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.164785 Jun 21 10:36:32.005006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 51/106] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:31 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:32.111110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:32.111819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:32.118724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:32.119289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:32.120078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:32.120515 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:32.264533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:32.277717 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-05a82a8c-a97f-4ed2-9be6-287f4391f0f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.170488 Jun 21 10:36:32.278304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 56/107] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:32 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:32.655034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:32.655931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:32.663149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:32.663587 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:32.664933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:32.665368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:32.813553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:32.821436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5c8944a8-d60a-4420-8d90-26bdf7e5f6e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.169969 Jun 21 10:36:32.822106 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 52/108] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:32 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:33.022235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:33.022806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:33.032122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.032122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.032122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.032122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.228600 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:33.237024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b5d1143c-54cf-40c8-b7f6-c179681092bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.218565 Jun 21 10:36:33.237599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 57/109] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:33 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:33.295005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:33.295659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:33.301737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.302464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.308304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.308709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.454359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:33.463737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a43847fe-72c0-42c2-ba8a-9f043e56bf5a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.172562 Jun 21 10:36:33.464699 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 53/110] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:33 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:33.839439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:33.840851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:33.847462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.848032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.848833 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:33.849259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:33.991661 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:34.001051 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d55a6578-5c8a-4d28-8eed-cf29c22846ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.165407 Jun 21 10:36:34.001808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 58/111] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:33 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:34.254149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:34.255198 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:34.262112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:34.262775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:34.263802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:34.264306 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:34.421061 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:34.429688 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-45e495d5-ce3c-4ea7-ae41-9d32fa4ed174 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.179431 Jun 21 10:36:34.431158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 54/112] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:34 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:34.484496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:34.485851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:34.531706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:34.532251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:34.533096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:34.533567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:34.694514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:34.703976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0635eff8-7525-44f3-bab4-f98d8d39efa5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.226760 Jun 21 10:36:34.704541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 59/113] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:34 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:35.019961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:35.020837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:35.028151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.031361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.032469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.032999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.271544 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:35.296399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3a2495bd-b17c-403e-bc01-601117e9daf6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.273174 Jun 21 10:36:35.296399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 55/114] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:35 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:35.448437 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:35.449389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:35.462599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.463588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.466340 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.468204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.619695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:35.624431 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:35.635123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-383ffd78-4ab4-4b89-b417-7463142fea14 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.191562 Jun 21 10:36:35.635806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 60/115] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:35 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:35.721901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:35.722612 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:35.729678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.730171 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.731155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:35.731591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:35.932425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:35.940663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0286e354-a8f0-45bb-b293-6d313e3ddcbb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.222581 Jun 21 10:36:35.941319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 56/116] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:35 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:36.306732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:36.307341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:36.315033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.315618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:36.316505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.317210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:36.513399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:36.529181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7b9580c7-ac95-4526-b94f-e87ab4ddad86 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.226597 Jun 21 10:36:36.530011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 61/117] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:36 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:36.652651 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:36.653192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:36.659853 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.660299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:36.661082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.661485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:36.810122 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:36.813565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:36.818468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4f7a86e2-0491-4a29-b1eb-fff2e0b31928 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.170124 Jun 21 10:36:36.819034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 57/118] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:36 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:36.958362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:36.958942 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:36.965370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.965826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:36.966655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:36.967085 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:37.105560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:37.113460 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3ea45fca-685f-4866-8ee0-45c2c6b9c8c9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.159483 Jun 21 10:36:37.114028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 62/119] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:36 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:37.551944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:37.552550 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:37.559668 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:37.560125 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:37.560894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:37.561342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:37.704578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:37.712868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-552a3321-491a-400a-8b94-77e443e94e1a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.165282 Jun 21 10:36:37.713430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 58/120] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:37 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:37.835739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:37.836510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:37.843076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:37.843524 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:37.844295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:37.844732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:37.980694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:37.988478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a4fca894-2ae3-4c36-a181-5033b4dbcda0 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.156659 Jun 21 10:36:37.989116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 63/121] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:37 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:38.131190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:38.131729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:38.138360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:38.138791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:38.139559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:38.139989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:38.280168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:38.287720 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9770d0ea-3ee4-4598-afb8-29f4f8c6bb39 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160583 Jun 21 10:36:38.288272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 59/122] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:38 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:38.730078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:38.730626 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:38.736940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:38.737411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:38.738199 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:38.738633 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:38.877941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:38.885910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-da6eb261-5e7e-4e4d-8fa9-e61219ec142c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.160410 Jun 21 10:36:38.886566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 64/123] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:38 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:39.007661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:39.008811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:39.015233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.015669 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:39.016420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.016839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:39.153980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:39.161739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b65311f4-b6d5-4504-851a-f1297b185a29 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.158200 Jun 21 10:36:39.162333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 60/124] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:39 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:39.305324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:39.305907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:39.307889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=76 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:39.313428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.313870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:39.314678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.315117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:39.463557 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:39.475095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-62f02084-38ea-4744-9726-8f07ece36cea tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.173867 Jun 21 10:36:39.475873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 65/125] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:39 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:39.904387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:39.904973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:39.912207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.912728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:39.913484 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:39.913909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:40.055230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:40.063143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e6854282-acc4-4744-ac92-ad7655fbe019 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.163699 Jun 21 10:36:40.063712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 61/126] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:39 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:40.179225 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:40.180050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:40.187964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:40.188405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:40.189157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:40.189552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:40.330019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:40.339878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f23ef023-2208-48f2-bc48-8cbcc1f7b002 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.164225 Jun 21 10:36:40.340771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:40 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:40.493864 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:40.494533 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:40.500834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:40.501311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:40.502220 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:40.502628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:40.637023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:40.644625 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-66671156-f79b-4e0f-a625-ec53dcaf08f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.154929 Jun 21 10:36:40.645184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 62/128] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:40 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:41.080870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:41.081533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:41.088258 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.088713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.089485 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.089928 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.245559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:41.251623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-805a65a2-e951-4a8e-bd90-ea1119ef7312 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.175110 Jun 21 10:36:41.252185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 67/129] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:41 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:41.358882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:41.359518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:41.366009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.366492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.367429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.367886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.509952 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:41.518191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-974d70dd-79a1-46cc-991d-ef15824c582e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.163131 Jun 21 10:36:41.519623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 63/130] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:41 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:41.661859 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:41.663044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:41.669277 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.669732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.670543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:41.670980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:41.813442 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:41.821648 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6e7b1a04-db56-4412-936b-cce2b2c7fa0b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.163238 Jun 21 10:36:41.822296 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 68/131] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:41 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:42.269162 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:42.270304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:42.278092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.278577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.279337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.279770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.413746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:42.421851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-55b816aa-26fc-4da1-8e70-f21badad5bf9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.156646 Jun 21 10:36:42.422529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 64/132] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:42 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:42.536111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:42.536631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:42.543380 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.543834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.544574 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.545002 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.679201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:42.687577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-74a30866-fdcb-4a56-86a5-c4b9b0a8d5d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.155438 Jun 21 10:36:42.688124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:42 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:42.839708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:42.840927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:42.848791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.849563 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.850387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:42.850813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:42.981442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:42.988971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd05c7b8-b764-48e2-97d0-f76ab0ec1e2e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.153470 Jun 21 10:36:42.989533 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 65/134] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:42 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:43.439164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:43.439791 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:43.446381 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:43.446828 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:43.447578 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:43.448011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:43.586911 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:43.594933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-87f682f1-16cb-4b7d-851d-bb41281fd66b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.159617 Jun 21 10:36:43.595512 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 70/135] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:43 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:43.705395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:43.706417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:43.713003 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:43.713581 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:43.714396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:43.714821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:43.854043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:43.862503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ef49bbbe-1b00-4134-a308-ecbf3073f3c3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.161247 Jun 21 10:36:43.863141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 66/136] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:43 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:44.007243 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:44.007930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:44.014189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.014642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:44.015409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.015845 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:44.149319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:44.157513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b8b9c4d8-5d49-4bab-a051-4e6426d5207e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.154768 Jun 21 10:36:44.158102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 71/137] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:44 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:44.612266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:44.612789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:44.614693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=78 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:44.621256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.621665 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:44.622451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.622879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:44.761985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:44.769722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd6916dd-2a75-42fd-b568-9d0a7aeb1f29 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.161434 Jun 21 10:36:44.770358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 67/138] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:44 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:44.880051 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:44.880537 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:44.887161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.887612 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:44.888397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:44.888806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:45.039894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:45.047603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c2336fea-0802-47bc-9245-70ead13d1f5a tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.171597 Jun 21 10:36:45.048142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 72/139] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:44 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:45.175410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:45.176012 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:45.182855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:45.183308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:45.184073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:45.184505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:45.325375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:45.333556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1cb4ec96-91fe-4804-aafb-c09afaf965ef tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.162033 Jun 21 10:36:45.334179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 68/140] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:45 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:45.789531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:45.790153 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:45.796795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:45.797235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:45.797993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:45.798455 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:45.931598 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:45.939457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-be6ef242-2052-422c-90f5-38856dc34d0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.154193 Jun 21 10:36:45.940044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 73/141] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:45 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:46.064832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:46.065441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:46.072324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.072767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:46.073531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.073948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:46.209586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:46.217734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5c58f481-b224-4790-9711-3080fbe5723e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.156691 Jun 21 10:36:46.218338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 69/142] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:46 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:46.351827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:46.352434 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:46.358953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.359407 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:46.360176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.360625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:46.499181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:46.507520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9340f13c-015e-4202-a8c7-090a558e84f8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.159622 Jun 21 10:36:46.508217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:46 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:46.957327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:46.957938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:46.965674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.966123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:46.967005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:46.967443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:47.109629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:47.117763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8459c351-50cf-40bd-8037-658b010650d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.164429 Jun 21 10:36:47.118549 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:46 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:47.235064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:47.235670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:47.242075 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:47.242576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:47.243425 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:47.243857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:47.378734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:47.386448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-99c1f885-1c2c-4251-a875-7c966db90f8b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.155321 Jun 21 10:36:47.387019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 75/145] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:47 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:47.526156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:47.527060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:47.533951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:47.534438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:47.535198 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:47.535635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:47.678585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:47.686784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1d7f651c-8916-4a2f-8c35-0006893229c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.164598 Jun 21 10:36:47.687351 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 71/146] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:47 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:48.135271 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:48.135871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:48.142395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.142864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.143647 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.144076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.309588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:48.317847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ca987ba4-a886-4dd8-9dd8-0867421a5a3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.187043 Jun 21 10:36:48.318504 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 76/147] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:48 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:48.403577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:48.404170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:48.410760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.411205 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.411978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.412407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.549496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:48.557727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8abac5c8-6833-4384-b915-4e17c703b9fc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.157980 Jun 21 10:36:48.558333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 72/148] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:48 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:48.704251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:48.704846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:48.711646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.712118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.712880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:48.713309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:48.733085 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:48.852204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:48.860242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cee66662-f6d8-4593-af7a-7d214f43f9f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160013 Jun 21 10:36:48.860822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 77/149] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:48 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:49.339240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:49.340249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:49.349965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.350674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.351866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.352531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.500123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:49.507721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9a94eaeb-4809-4940-9f4e-443c771a5e81 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.175150 Jun 21 10:36:49.508695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 73/150] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:49 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:49.575507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:49.576101 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:49.582939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.583401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.584128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.584572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.729807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:49.737551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1d0a2089-efc0-45f4-9b2f-0f0530066932 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.165899 Jun 21 10:36:49.738116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 78/151] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:49 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:49.878644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:49.879182 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:49.886500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.886935 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.887696 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:49.888090 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:49.908353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:50.026322 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:50.034508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-01a7f9c2-c2b7-4b55-82c5-d1353452b868 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.159871 Jun 21 10:36:50.035108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 74/152] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:49 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:50.525449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:50.526195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:50.532618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.533053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.533810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.534284 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.584722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-a1133726-a79a-4195-9af8-4f8eef36ec30 req-5db8d60d-5eb4-487b-a9d5-e11e1d9341bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59895c2d-27a0-4bbb-8fad-a6512041d87f", "name": "network-vif-plugged", "status": "completed", "tag": "b79d70d7-f715-4336-a3e6-dcaf0e33ceb0"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:50.597652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a1133726-a79a-4195-9af8-4f8eef36ec30 req-5db8d60d-5eb4-487b-a9d5-e11e1d9341bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.597652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a1133726-a79a-4195-9af8-4f8eef36ec30 req-5db8d60d-5eb4-487b-a9d5-e11e1d9341bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.618356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-a1133726-a79a-4195-9af8-4f8eef36ec30 req-5db8d60d-5eb4-487b-a9d5-e11e1d9341bf service nova] Creating event network-vif-plugged:b79d70d7-f715-4336-a3e6-dcaf0e33ceb0 for instance 59895c2d-27a0-4bbb-8fad-a6512041d87f on hv-cinder-83697 Jun 21 10:36:50.618725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a1133726-a79a-4195-9af8-4f8eef36ec30 req-5db8d60d-5eb4-487b-a9d5-e11e1d9341bf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124180) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 10:36:50.619868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.620297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.621070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.621489 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.630726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.compute.rpcapi [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 10:36:50.631630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] Releasing lock "compute-rpcapi-router" {{(pid=124180) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 10:36:50.648409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4aa69286-8708-4543-a624-e43ba5b375ce None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067593 Jun 21 10:36:50.649582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 75/153] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:36:50.690158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:50.698250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1f9355bf-4aad-4576-bff9-9b0c1bc62608 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.177154 Jun 21 10:36:50.698830 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 79/154] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:50 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:50.755879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:50.756647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:50.763840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.764284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.765093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:50.765558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:50.907411 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:50.915399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-223e5dc8-6a84-4756-ad0c-ee71ac5430b1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.163938 Jun 21 10:36:50.915972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 76/155] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:50 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:51.051573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:51.052171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:51.059324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.059772 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:51.060547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.060983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:51.194358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:51.202238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4a1b99e4-17ca-489e-a685-dcb07262c14a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.154623 Jun 21 10:36:51.202854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 80/156] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:51 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:51.716025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:51.716637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:51.723103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.723552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:51.724353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.724821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:51.859681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:51.867724 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b793e749-ac7a-4587-9c5a-5fa4f1cf59c7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.155918 Jun 21 10:36:51.868293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 77/157] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:51 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:51.936336 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:51.936937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:51.943463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.943906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:51.944658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:51.945080 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:52.081323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:52.089263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3343ce82-49c0-4377-ac36-20ebf2481071 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.160573 Jun 21 10:36:52.089834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 81/158] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:51 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:52.219648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:52.220462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:52.227527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:52.227966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:52.228720 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:52.229144 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:52.365470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:52.375942 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bbabed94-161a-418a-8944-b83a8c4c47a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160084 Jun 21 10:36:52.376524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 78/159] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:52 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:52.884914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:52.885458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:52.891801 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:52.892287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:52.893046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:52.893469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.031077 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:53.040190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-85df30d4-1bb8-4719-a8f1-15f6379f4a2c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.158335 Jun 21 10:36:53.040794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 82/160] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:52 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:53.106774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:53.107387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:53.114251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:53.114838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.115622 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:53.116057 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.258507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:53.266316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-816b84ad-d958-483c-81cb-66efd1d6b74c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.163614 Jun 21 10:36:53.267096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 79/161] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:53 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:53.399855 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:53.400638 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:53.406754 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:53.407177 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.407999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:53.408933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.548991 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:53.564874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c5dc8c1f-0b11-413e-a98d-5cad7c1d3d90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.169524 Jun 21 10:36:53.565971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 83/162] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:53 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:53.698955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-a7bd4a23-bf31-4073-97cc-fdeeaf8cbe05 req-ea60e7ef-5021-4682-a75c-7f623f64dbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41dcf0af-2c3f-40a6-82a7-86f4be479e9e", "name": "network-vif-plugged", "status": "completed", "tag": "b7baf3ca-b0e6-48a9-976e-a9d0f3332f16"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:36:53.708798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a7bd4a23-bf31-4073-97cc-fdeeaf8cbe05 req-ea60e7ef-5021-4682-a75c-7f623f64dbd5 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:53.709529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a7bd4a23-bf31-4073-97cc-fdeeaf8cbe05 req-ea60e7ef-5021-4682-a75c-7f623f64dbd5 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:53.735019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-a7bd4a23-bf31-4073-97cc-fdeeaf8cbe05 req-ea60e7ef-5021-4682-a75c-7f623f64dbd5 service nova] Creating event network-vif-plugged:b7baf3ca-b0e6-48a9-976e-a9d0f3332f16 for instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e on hv-cinder-83697 Jun 21 10:36:53.735019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-a7bd4a23-bf31-4073-97cc-fdeeaf8cbe05 req-ea60e7ef-5021-4682-a75c-7f623f64dbd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039676 Jun 21 10:36:53.735477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 80/163] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:36:54.061639 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:54.062603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:54.069247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.070172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.071336 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.072133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.222833 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:54.231597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1d5591f8-9eac-4a88-bf78-804010878a87 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.173812 Jun 21 10:36:54.232381 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 84/164] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:54 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:54.284447 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:54.285173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:54.292460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.292900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.293661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.294118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.427417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:54.435759 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e2a0cc03-9821-459a-a397-d4cc5043efa3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.155672 Jun 21 10:36:54.436315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 81/165] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:54 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:54.583737 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:54.584303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:54.591400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.591849 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.592617 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:54.593053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:54.731944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:54.739903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-36dce324-218a-4d68-8431-585396c6bbdd tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.160441 Jun 21 10:36:54.740461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 85/166] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:54 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:55.249691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:55.250649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:55.256961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.257459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.258238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.258827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.425329 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:55.432997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a7ca6015-5e0a-4cff-8109-7aea94c4cc2a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.187973 Jun 21 10:36:55.433558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 82/167] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:55 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:55.455093 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:55.456334 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:55.462793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.463242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.464005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.464469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.610762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:55.618787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b2e919e5-a3c5-49ee-accf-aa72f748dbb5 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.167506 Jun 21 10:36:55.619363 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 86/168] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:55 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:55.757097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:55.758016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:55.764821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.765258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.766015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:55.766463 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:55.907829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:55.915806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-95222518-d72b-4e4a-ae25-6acbb98043e0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.162563 Jun 21 10:36:55.916378 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 83/169] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:55 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:56.449261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:56.449873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:56.456646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.457106 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:56.457880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.458347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:56.603639 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:56.611670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-955bc1d3-c546-4310-bf80-d09144c40b01 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.166544 Jun 21 10:36:56.612332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 87/170] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:56 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:56.636135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:56.636671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:56.642953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.643394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:56.644159 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.644589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:56.777882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:56.785512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7dbbccfb-e3d0-46a1-912e-d8be708bbef8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.153546 Jun 21 10:36:56.786073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 84/171] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:56 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:56.932889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:56.933501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:56.940025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.940474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:56.941234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:56.941676 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:57.078335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:57.087254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2477ca53-b080-4397-975e-aae8a9f21176 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.158278 Jun 21 10:36:57.087834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 88/172] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:56 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:57.629492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:57.630415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:57.637291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:57.637930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:57.638537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:57.638968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:57.774357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:57.781920 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-363fd0d6-396e-43bf-8057-9fb506219a44 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.156812 Jun 21 10:36:57.782520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 85/173] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:57 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:57.802611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:57.803270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:57.809593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:57.810044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:57.810832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:57.811278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:57.948739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:57.957089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a7a3c02d-f02d-4cfb-948a-7f6967f14837 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.158311 Jun 21 10:36:57.957663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 89/174] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:57 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:58.105009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:58.105595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:58.112398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.112859 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:58.113619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.114065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:58.262535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:58.275294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bc3eb0f2-e3a5-4e44-8932-aee2dc7a1924 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.173668 Jun 21 10:36:58.286116 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 86/175] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:58 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:58.804815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:58.806235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:58.818941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.819752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:58.821307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.822120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:58.975623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:58.976528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:58.985507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.986253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:58.987478 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:58.987652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:58.988196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:59.001176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fb040821-52bc-4787-b84c-209a7e478b4c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.204837 Jun 21 10:36:59.002275 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 90/176] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:58 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:36:59.174382 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:59.183192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b3f9bde7-f658-4def-a017-9c3b0b4444c8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.211887 Jun 21 10:36:59.183742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 87/177] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:58 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:36:59.299355 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:36:59.300035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:36:59.307544 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:59.308123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:59.309051 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:36:59.309527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:36:59.471331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:36:59.480588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1450af9-2f0b-41e5-bc20-bbd204bbf84b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.185410 Jun 21 10:36:59.481335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 91/178] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:36:59 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:00.025613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:00.026297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:00.033103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.033580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.034529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.035023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.188436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:00.197471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-629294bb-8fa6-4859-bb1b-98f20b1af9e3 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.175697 Jun 21 10:37:00.198154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 88/179] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:00 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:00.209355 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:00.210108 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:00.217614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.218091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.218915 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.219350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.466001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:00.485773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8e1c1f8e-59a7-44d3-abee-a5f29b934667 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.280301 Jun 21 10:37:00.487272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 92/180] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:00 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:00.502715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:00.507645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:00.531241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.534799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.539119 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:00.541782 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:00.632664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:00.944275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:00.953808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d7d32fbc-4613-4c20-b8d1-7a2f1426ed0e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.458176 Jun 21 10:37:00.954603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 89/181] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:00 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:01.221246 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:01.222482 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:01.242544 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.243975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.247384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.248759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.516897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:01.517982 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:01.537216 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.538034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.540706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.541485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.652540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:01.687799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bee6889f-b12d-4e71-8638-ce796bfc0337 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.475429 Jun 21 10:37:01.689175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 93/182] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:01 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:01.819957 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:01.828239 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-426ba0d9-9da1-4b9f-96d6-1a2262c65b1c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.318507 Jun 21 10:37:01.828840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 90/183] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:01 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:01.981644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:01.982456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:01.989511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.990095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.991115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:01.992001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:01.997048 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:02.154168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:02.168857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-54fcc5dd-6d8b-41cd-be7a-fca7fec06624 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.190898 Jun 21 10:37:02.169898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 94/184] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:01 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:02.707564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:02.708464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:02.717095 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:02.717839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:02.719301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:02.719971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:02.860399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:02.861798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:02.871195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:02.871989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:02.873233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:02.873975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:02.972874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:02.983896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bdd091c7-5485-4699-92ae-e4397033d24a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.281505 Jun 21 10:37:02.985652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 91/185] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:02 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:03.048740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-6ef2e1be-d32b-4a8f-8dc7-fcc5d670281e req-4631f0e4-2aac-4eca-896f-eec37f4efcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27ba21f-6661-4761-8ee2-b0c85ba56fad", "name": "network-vif-plugged", "status": "completed", "tag": "ce8496d1-3043-4a28-b9ce-bc6b3d0176fc"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:03.065050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-6ef2e1be-d32b-4a8f-8dc7-fcc5d670281e req-4631f0e4-2aac-4eca-896f-eec37f4efcfb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:03.065828 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-6ef2e1be-d32b-4a8f-8dc7-fcc5d670281e req-4631f0e4-2aac-4eca-896f-eec37f4efcfb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:03.074678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:03.089564 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:03.092998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-6ef2e1be-d32b-4a8f-8dc7-fcc5d670281e req-4631f0e4-2aac-4eca-896f-eec37f4efcfb service nova] Creating event network-vif-plugged:ce8496d1-3043-4a28-b9ce-bc6b3d0176fc for instance b27ba21f-6661-4761-8ee2-b0c85ba56fad on hv-cinder-83697 Jun 21 10:37:03.100786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-6ef2e1be-d32b-4a8f-8dc7-fcc5d670281e req-4631f0e4-2aac-4eca-896f-eec37f4efcfb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057580 Jun 21 10:37:03.102618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 92/186] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:37:03.109214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-badcce35-ec40-44a2-8677-c050325c13db tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.262890 Jun 21 10:37:03.109796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 95/187] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:02 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:03.187074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:03.188082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:03.196301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:03.196709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:03.197679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:03.198132 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:03.478251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:03.490544 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-371a9fe2-c32d-4d90-841d-646c47e22f76 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.308342 Jun 21 10:37:03.500847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 93/188] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:03 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:04.009953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:04.011239 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:04.025134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.025134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.025134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.025134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.134457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:04.134457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:04.149582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.150379 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.152308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.153083 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.290649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:04.312251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-11b571da-aacd-4187-9eee-deb18cef3d65 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.310714 Jun 21 10:37:04.322273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 96/189] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:03 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:04.356984 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:04.372881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-81df9098-863a-4d29-8a91-160186437017 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.246865 Jun 21 10:37:04.372881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 94/190] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:04 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:04.513273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:04.514602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:04.525811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.526591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.528114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:04.529126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:04.816474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:04.826662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc87fb7a-b956-4c22-bba8-a5e4f50200b5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.322012 Jun 21 10:37:04.827245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 97/191] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:04 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:05.334541 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:05.335633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:05.347883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.348618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.349988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.350796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.399380 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:05.400459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:05.411920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.412683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.414227 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.415040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.734763 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:05.748517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50a9d3da-feeb-4a71-9003-f31caa9940d2 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.354930 Jun 21 10:37:05.749514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 98/192] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:05 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:05.862883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:05.864429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:05.890362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:05.892311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.892902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.894223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:05.894887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:05.910105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a9e2c911-5aef-4ace-932d-8a2705be290c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1321 microversion: 2.1 time: 0.582932 Jun 21 10:37:05.911958 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 95/193] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:05 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:06.138472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:06.158735 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3aec4e01-d2b7-48b7-86d4-133775f6be20 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.307296 Jun 21 10:37:06.159522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 99/194] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:05 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:06.774714 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:06.775583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:06.783448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:06.784006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:06.785000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:06.785515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:06.932163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:06.933071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:06.939496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:06.939935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:06.940706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:06.941146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:06.944403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:06.953477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8c542bd6-30f9-4f59-ab77-2e8c5a04dc88 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.184058 Jun 21 10:37:06.954353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 96/195] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:06 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:07.127563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:07.137749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5203962d-8c05-4a15-97d3-e44ab6eb8497 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1515 microversion: 2.1 time: 0.210102 Jun 21 10:37:07.138669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 100/196] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:06 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:07.178011 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:07.178011 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:07.185238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.187003 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.187687 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:07.188255 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.189242 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.189445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:07.197115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.197588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.198500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.199570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.364644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lazy-loading 'flavor' on Instance uuid 59895c2d-27a0-4bbb-8fad-a6512041d87f {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:37:07.531204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-299b0909-f3fe-48c3-9748-05f0eab564da tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f/action" status: 200 len: 32 microversion: 2.1 time: 0.369425 Jun 21 10:37:07.531870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 97/197] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:37:07 2022] POST /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:37:07.545448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:07.546266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:07.554271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.554892 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.555849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.556383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.688269 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:07.698130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-33beba8e-c111-4ea9-b837-18adaa478dde tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.514984 Jun 21 10:37:07.698752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 101/198] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:07 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:07.739155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:07.747811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1fc55e53-e6c8-4420-a691-1e85069155d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.207670 Jun 21 10:37:07.748441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 98/199] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:07 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:07.972892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:07.973487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:07.980771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.981229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:07.981989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:07.982465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:08.135935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:08.143973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-da116fbb-cf1f-4ed7-b53d-a42b26d880f3 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.175119 Jun 21 10:37:08.144561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 102/200] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:07 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:08.718190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:08.718853 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:08.725955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:08.726488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:08.727360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:08.727875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:08.768610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:08.769578 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:08.781187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:08.781987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:08.783076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:08.783591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:08.909366 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:08.918850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c6ad0060-3a15-4f7e-a8c1-30e1648d6c50 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.204818 Jun 21 10:37:08.919747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 99/201] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:08 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:08.994323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:09.003806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-89640ea4-4374-4856-a1dc-56f78a82b73e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.242234 Jun 21 10:37:09.004673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 103/202] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:08 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:09.162232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:09.163946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:09.171441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:09.172008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:09.172996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:09.173470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:09.359715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:09.371727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-37868a41-1aca-42b3-b128-f3c64709e7bd tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.214084 Jun 21 10:37:09.372703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 100/203] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:09 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:09.936843 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:09.937340 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:09.939446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=78 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:09.946323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:09.946936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:09.947854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:09.948377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:10.028225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:10.029311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:10.041334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:10.042155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:10.044594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:10.044779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:10.113644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:10.123657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-faafa954-29b7-49bb-ac12-914ff5c8bd6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1362 microversion: 2.1 time: 0.190764 Jun 21 10:37:10.124462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 104/204] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:09 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:10.217002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:10.230268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd2cad5c-9459-447d-84e2-7d5762f27527 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.209506 Jun 21 10:37:10.231270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 101/205] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:10 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:10.390664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:10.391323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:10.399076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:10.399614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:10.400570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:10.401125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:10.563632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:10.573103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cb52231c-4cd4-4f82-86c1-a3e86fe23e1d tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.186608 Jun 21 10:37:10.573720 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 105/206] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:10 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:11.151758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:11.152828 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:11.165041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.165394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.166873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.167637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.265701 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:11.266806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:11.280310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.281466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.282885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.283956 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.476113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:11.513280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1073b12e-763e-44df-aea0-fb3417fd4a0f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.247963 Jun 21 10:37:11.515055 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 106/207] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:11 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:11.597856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:11.599278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:11.610824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.612139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.614153 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.615162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.813169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:11.829824 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0ddc4e96-d784-4ac2-a4c1-5526bba01da1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1549 microversion: 2.1 time: 0.685749 Jun 21 10:37:11.842942 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 102/208] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:11 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1549 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:11.854026 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:11.859959 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:11.860815 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:11.869265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.869765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.870932 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:11.871548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:11.871933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-815c4a68-7a62-4bb7-aa8e-a5ae58157cfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.282541 Jun 21 10:37:11.886905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 107/209] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:11 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:11.966513 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d570e0ce-d4b6-4284-8913-66efaa132807 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112912 Jun 21 10:37:11.968337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 103/210] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:37:11 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:37:12.544156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:12.545181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:12.555769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:12.556765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:12.558511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:12.559198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:12.904228 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:12.905327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:12.916933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:12.917746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:12.919432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:12.920557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:12.976240 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:12.984839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5b03ac00-02b2-476f-b65a-cb343e3f06cf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.449307 Jun 21 10:37:12.985770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 108/211] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:12 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:13.197096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:13.217121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ff8c9c17-777c-4d61-baca-b415302fc1f4 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.317795 Jun 21 10:37:13.220429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 104/212] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:12 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:13.799223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-a8d19bcb-4d18-4486-883f-521385f3ce78 req-3276e85d-c189-42a1-b6d0-e5c336d2b1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41dcf0af-2c3f-40a6-82a7-86f4be479e9e", "tag": "b7baf3ca-b0e6-48a9-976e-a9d0f3332f16"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:13.811047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a8d19bcb-4d18-4486-883f-521385f3ce78 req-3276e85d-c189-42a1-b6d0-e5c336d2b1c8 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:13.811784 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-a8d19bcb-4d18-4486-883f-521385f3ce78 req-3276e85d-c189-42a1-b6d0-e5c336d2b1c8 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:13.827797 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-a8d19bcb-4d18-4486-883f-521385f3ce78 req-3276e85d-c189-42a1-b6d0-e5c336d2b1c8 service nova] Creating event network-changed:b7baf3ca-b0e6-48a9-976e-a9d0f3332f16 for instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e on hv-cinder-83697 Jun 21 10:37:13.838473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-a8d19bcb-4d18-4486-883f-521385f3ce78 req-3276e85d-c189-42a1-b6d0-e5c336d2b1c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045784 Jun 21 10:37:13.839539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 109/213] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:37:14.011742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:14.013101 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:14.023014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:14.023893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:14.025253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:14.025995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:14.239510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:14.240740 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:14.251068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:14.251526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:14.252360 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:14.252858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:14.304375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:14.315476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bac406f8-7d8b-40e6-8ccf-00543f8e1048 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.311477 Jun 21 10:37:14.325938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 105/214] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:14 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:14.514364 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:14.525241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-41f72dc7-90dd-4117-b022-24034ca3a96c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.291702 Jun 21 10:37:14.526083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 110/215] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:14 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:15.336475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:15.337326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:15.346318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=78 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:15.349736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:15.351726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:15.353922 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:15.354679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:15.546871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:15.547910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:15.557750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:15.558303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:15.559279 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:15.559981 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:15.596936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:15.612061 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fdc8abd8-e2a2-4942-8358-8d3ecbcada48 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.279835 Jun 21 10:37:15.613820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 106/216] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:15 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:15.622192 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:15.774546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:15.784090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-93871cfa-feb6-4960-ad71-b54e8f18bfa1 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.242920 Jun 21 10:37:15.785105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 111/217] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:15 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:16.636948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:16.642543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:16.662837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:16.664653 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:16.666685 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:16.667755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:16.808868 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:16.810096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:16.822518 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:16.823391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:16.825171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:16.825990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:17.047134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:17.064520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ae7b6309-5af3-44d8-a4b7-6ad988f42f49 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.264892 Jun 21 10:37:17.065992 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 112/218] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:16 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:17.303663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:17.308167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:17.315579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ec50992d-6ebf-445c-a86f-c93450d1b885 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.686542 Jun 21 10:37:17.316496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 107/219] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:16 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:18.086623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:18.087591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:18.097734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:18.098972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:18.100524 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:18.101273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:18.330103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:18.345125 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:18.346217 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:18.359222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4a268898-2097-45e5-9f12-35176b835e45 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.278757 Jun 21 10:37:18.360263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 113/220] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:18 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:18.370583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:18.371315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:18.372194 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:18.372915 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:18.568344 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:18.576697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cc51a030-94bf-4132-8eaf-fed9ee50bf3a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.238969 Jun 21 10:37:18.577291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 108/221] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:18 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:19.380471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:19.381126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:19.388558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:19.389227 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:19.390085 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:19.390553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:19.571094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:19.580566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1c7a72bb-8228-4e64-8b30-3c87ed1087f6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.203648 Jun 21 10:37:19.581273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 114/222] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:19 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:19.597050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:19.597662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:19.605691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:19.606176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:19.606977 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:19.607401 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:19.787227 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:19.796056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9bb3aa17-5e4e-4629-b9c1-a2770e13ec9e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.202953 Jun 21 10:37:19.797429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 109/223] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:19 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:20.603889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:20.604922 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:20.615406 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:20.616126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:20.618480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:20.619178 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:20.791043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:20.800980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-05d541d7-526a-4706-b4d1-88822a84d091 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.204674 Jun 21 10:37:20.802318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 115/224] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:20 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:20.821531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:20.822217 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:20.829097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:20.829552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:20.830730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:20.831147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:21.000160 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:21.008930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3ef4d230-396e-45e2-8c06-27772f134d31 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.191724 Jun 21 10:37:21.009534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 110/225] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:20 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:21.828090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:21.829019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:21.837009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:21.837595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:21.838741 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:21.839408 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:21.998023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:22.008784 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-274342cd-67d2-453a-9598-b9a13462c5de tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.186134 Jun 21 10:37:22.009733 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 116/226] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:21 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:22.030526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:22.031347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:22.038451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:22.038822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:22.039585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:22.040026 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:22.315472 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:22.324839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d8ff6570-9c6b-4bf4-a0f4-95bd91c449d8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.299620 Jun 21 10:37:22.325410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 111/227] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:22 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:23.047710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:23.054351 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:23.065902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:23.067143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:23.068669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:23.071223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:23.332742 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:23.341774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-387faa4f-f7aa-4004-9f6a-bc205a0312ae tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1315 microversion: 2.1 time: 0.312857 Jun 21 10:37:23.342392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 117/228] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:23 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:23.343021 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:23.343732 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:23.351345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:23.352067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:23.352980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:23.353519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:23.587116 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:23.595701 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1ea854b5-5846-4df4-be2c-f4960e25af62 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.256673 Jun 21 10:37:23.596421 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 112/229] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:23 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:24.364040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:24.365976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:24.380477 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:24.382012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:24.383989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:24.385097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:24.621084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:24.627403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:24.658300 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:24.660494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:24.664131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:24.665631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:24.667991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:24.684798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-562272f1-c24e-48c2-8f31-2b2406c5fbfc tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1503 microversion: 2.1 time: 0.328313 Jun 21 10:37:24.685764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 118/230] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:24 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:25.151725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:25.166992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4fca4e36-08c6-492f-9cea-84c2b227d519 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.556117 Jun 21 10:37:25.185882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 113/231] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:24 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:26.204206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:26.207029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:26.219344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:26.220771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:26.222201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:26.223195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:26.532572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:26.552846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-08b10035-50be-44cc-83fc-a0df267cee0d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.358983 Jun 21 10:37:26.553560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 119/232] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:26 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:26.627605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cb21a6d-7a5e-429a-9d20-57bf88d6d76a"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:26.628987 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:26.653850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:26.654517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:26.662339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:26.662988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:27.265439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a813ba48-76ba-4596-8456-fc8e8ccf7c13 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "POST /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644616 Jun 21 10:37:27.266469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 114/233] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:37:26 2022] POST /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:37:27.576030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:27.576879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:27.588645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:27.589768 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:27.591167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:27.591965 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:27.868637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:27.883084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-892fe9bb-fcaf-41d0-955e-2dc63339c82b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.314232 Jun 21 10:37:27.884476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 120/234] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:27 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:28.906304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:28.908703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:28.922649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:28.923486 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:28.925374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:28.926473 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:29.284051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:29.297725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5cdfcfd5-7e7e-4caa-8e1d-6b724aa2769f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.398927 Jun 21 10:37:29.307165 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 115/235] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:28 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:30.332969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:30.344987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:30.366511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:30.373707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:30.375753 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:30.379438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:30.848567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:30.858432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c7ed8bed-a03b-4fcd-a6b6-e219569a99b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.536075 Jun 21 10:37:30.870514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 121/236] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:30 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:31.886173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:31.889855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:31.908629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:31.910179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:31.912419 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:31.914784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:32.285895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:32.300281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-078bc57a-13d8-40e4-b78b-aa9dcfa807db tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.424919 Jun 21 10:37:32.314438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 116/237] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:31 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:33.330435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:33.330435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:33.333112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:33.333774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:33.335526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:33.337213 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:33.629939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:33.644580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-deaee0f0-a9d3-4d17-95a1-ffbe6e7091a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.325847 Jun 21 10:37:33.645569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 122/238] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:33 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:34.674387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:34.675513 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:34.689018 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:34.689810 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:34.691479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:34.706601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:34.955300 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:34.969000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-57bbc2e9-bd81-435c-92a3-01d72461c4f2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.302383 Jun 21 10:37:34.970715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 117/239] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:34 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:35.997385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:35.997974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:36.005078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:36.005601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:36.006691 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:36.007229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:36.211453 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:36.221841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1b4a7f22-aa47-4fab-b17c-ae57c37f7ef9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.228657 Jun 21 10:37:36.222585 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 123/240] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:35 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:36.874331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-23366458", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "networks": [{"uuid": "fb205f36-3fd5-4f5a-96e2-bc5dda48ab75"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:36.953193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] validate_networks() for [('fb205f36-3fd5-4f5a-96e2-bc5dda48ab75', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:37:37.248201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:37.249601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:37.259812 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:37.260609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:37.261868 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:37.262527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:37.401284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:37:37.401749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:37:37.402256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:37:37.402665 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:37:37.403078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:37:37.413813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:37.414700 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:37.415799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:37.416276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:37.440571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Getting quotas for project 849b037f3f424220b53da5537c2cebf3. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:37:37.449166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Getting quotas for user 3eb8cf247b6b4d6981191b804790f5f0 and project 849b037f3f424220b53da5537c2cebf3. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:37:37.472270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:37:37.477134 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:37:37.480953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:37.490997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4fb9593e-adf8-4222-8c3e-669e9cccc726 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.249495 Jun 21 10:37:37.492167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 124/241] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:37 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:37.553407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4ac9f17b-b178-4d0c-a677-f7e1d2a559e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685536 Jun 21 10:37:37.558313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 118/242] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:37:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:37:37.565073 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22f0dbfc-6138-40cf-a1b4-07fef7ac1f14 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:37.565696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-22f0dbfc-6138-40cf-a1b4-07fef7ac1f14 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:37.645312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22f0dbfc-6138-40cf-a1b4-07fef7ac1f14 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:37.655653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22f0dbfc-6138-40cf-a1b4-07fef7ac1f14 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1217 microversion: 2.1 time: 0.094104 Jun 21 10:37:37.656934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 125/243] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:37 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:38.517621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:38.518456 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:38.526805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:38.527360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:38.528339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:38.529022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:38.681265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:38.682436 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:38.696553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:38.697736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:38.701045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:38.702509 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:38.780968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:38.794806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2fb0c55a-8c2e-4953-91f2-71e08941ce6b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.285127 Jun 21 10:37:38.796001 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 119/244] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:38 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:38.820553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:38.830111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-52e16438-9dae-456f-aff2-6a5d7c5794f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1269 microversion: 2.1 time: 0.156295 Jun 21 10:37:38.830804 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 126/245] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:38 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:39.030805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1301912417", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "networks": [{"uuid": "3bcd5663-1bdd-4928-ac0f-b80363bd83f5"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:39.102156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] validate_networks() for [('3bcd5663-1bdd-4928-ac0f-b80363bd83f5', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:37:39.255947 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:39.256905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:39.276558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.277355 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:39.279049 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.279776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:39.320126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:37:39.528554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:39.667030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d37267b6-5157-4d10-9915-a983d08131d6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 204 len: 0 microversion: 2.1 time: 0.419132 Jun 21 10:37:39.668409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 127/246] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:37:39 2022] DELETE /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:37:39.680053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:39.681598 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:39.691496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.692025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:39.692994 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.693508 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:39.940032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:39.964260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d0cdb424-0d31-431a-b20f-fd1b6078b23e tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1555 microversion: 2.1 time: 0.286918 Jun 21 10:37:39.964260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 128/247] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:39 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:39.973494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:39.975374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:39.979218 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:39.994161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.994938 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:39.996280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:39.996831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:40.235910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:40.261237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cc0637cc-adb4-4e7b-9a3a-4f3c57e357a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.295239 Jun 21 10:37:40.262722 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 129/248] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:39 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:40.285577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:40.286904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:40.305585 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:40.306563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:40.307847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:40.308502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:40.325538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:37:40.326330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:37:40.327394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:37:40.328334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:37:40.329051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:37:40.370203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:40.370995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:40.372497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:40.373282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:40.408564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Getting quotas for project b902945afee143b19beb3366841fd72d. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:37:40.419516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Getting quotas for user 0e92ccbb22394817bd8a4224cc0d4e13 and project b902945afee143b19beb3366841fd72d. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:37:40.442734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:37:40.447174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:37:40.457100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:40.471935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5be39acf-6dde-4150-ba18-47a6b951f9f5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1287 microversion: 2.1 time: 0.206081 Jun 21 10:37:40.473335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 130/249] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:40 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:40.534662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6f4bee72-5bd2-4437-a57f-c7c7ac911229 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507522 Jun 21 10:37:40.536389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 120/250] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:37:40.553775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d1eb3540-4da4-47aa-8ea8-e0d8f6e87885 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:40.555881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d1eb3540-4da4-47aa-8ea8-e0d8f6e87885 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:40.676831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d1eb3540-4da4-47aa-8ea8-e0d8f6e87885 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:40.685961 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d1eb3540-4da4-47aa-8ea8-e0d8f6e87885 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1214 microversion: 2.1 time: 0.139223 Jun 21 10:37:40.690374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 131/251] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:40 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:41.003469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:41.005808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:41.019877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.021515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.024909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.026565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.291096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:41.292045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:41.302719 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.303161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.308032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.308932 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.347106 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:41.358014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8e15d353-4d7a-4d2f-8d6d-e7a9be02d59b tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1555 microversion: 2.1 time: 0.363564 Jun 21 10:37:41.359934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 121/252] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:40 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1555 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:41.493628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:41.494423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:41.513969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.520508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.521561 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.526411 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.606255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:41.617364 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a755a43f-6d99-4e6d-9263-6420430837cc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.332556 Jun 21 10:37:41.618543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 132/253] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:41 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:41.697372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:41.707336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0f64f1af-ecd2-451c-82b2-ad8d828e1ecc tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1275 microversion: 2.1 time: 0.219727 Jun 21 10:37:41.708296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 122/254] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:41 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:41.724737 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:41.728696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:41.754904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.755655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.757111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:41.757855 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:41.883441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:41.899176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e2a9b29e-a597-4518-b4ba-a48ca3482625 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1210 microversion: 2.1 time: 0.181610 Jun 21 10:37:41.900265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 133/255] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:41 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:42.383690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:42.388869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:42.408474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:42.414571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:42.416375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:42.422168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:42.667878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:42.671278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:42.702267 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:42.704050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:42.706649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:42.708010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:43.124787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:43.138730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-731d8152-0002-49cb-85ab-824129055e6e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.503748 Jun 21 10:37:43.139756 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 134/256] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:42 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:43.156669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:43.158007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:43.168857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:43.169351 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:43.170748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:43.171478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:43.485965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:43.500981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-71b6ed49-502b-4dbc-aff3-f13563dfe20c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1555 microversion: 2.1 time: 1.126604 Jun 21 10:37:43.501585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 123/257] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:42 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1555 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:43.516319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:43.516944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:43.540787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:43.541238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:43.541463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:43.542043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:43.542506 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:43.556912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-71c6bdad-149e-42be-b424-9001373cf11f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.404588 Jun 21 10:37:43.581625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 135/258] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:43 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:43.590812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:43.769009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:43.783884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f3187982-7041-4c23-85da-3939e95129dd tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1272 microversion: 2.1 time: 0.271530 Jun 21 10:37:43.797589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 124/259] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:43 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:44.158933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:44.160257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:44.168280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.169060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.170111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.170873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.434614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:44.450250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cb8d8ff5-4e9f-4b3c-9d9d-19474781d8b4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.295807 Jun 21 10:37:44.458175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 136/260] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:44 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:44.538288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:44.541055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:44.580230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.590454 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.598243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.599727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.608372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:44.609013 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:44.628665 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.629135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.629956 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.631490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.922546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:44.934273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bae5d448-2eaa-4464-be16-0b9f0fa566e5 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.329626 Jun 21 10:37:44.938115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 137/261] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:44 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:44.956992 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:44.958106 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:44.969191 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.969704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:44.971698 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:44.972431 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:45.060082 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:45.069110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fe63e536-7b9b-4719-a71b-c3463b12b964 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1272 microversion: 2.1 time: 0.130296 Jun 21 10:37:45.071213 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 138/262] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:44 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:45.337045 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:45.345006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5f12b3cb-affd-4fc4-b56c-95590ef71357 req-c753b53d-b2f1-4032-8303-60b8712a2bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27ba21f-6661-4761-8ee2-b0c85ba56fad", "name": "network-vif-deleted", "tag": "ce8496d1-3043-4a28-b9ce-bc6b3d0176fc"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:45.353607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-200f5af4-a619-406e-b808-2343a4268214 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1555 microversion: 2.1 time: 0.834477 Jun 21 10:37:45.362979 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 125/263] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:44 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1555 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:45.384587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5f12b3cb-affd-4fc4-b56c-95590ef71357 req-c753b53d-b2f1-4032-8303-60b8712a2bca service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:45.385625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5f12b3cb-affd-4fc4-b56c-95590ef71357 req-c753b53d-b2f1-4032-8303-60b8712a2bca service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:45.408259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5f12b3cb-affd-4fc4-b56c-95590ef71357 req-c753b53d-b2f1-4032-8303-60b8712a2bca service nova] Creating event network-vif-deleted:ce8496d1-3043-4a28-b9ce-bc6b3d0176fc for instance b27ba21f-6661-4761-8ee2-b0c85ba56fad on hv-cinder-83697 Jun 21 10:37:45.424826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5f12b3cb-affd-4fc4-b56c-95590ef71357 req-c753b53d-b2f1-4032-8303-60b8712a2bca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084097 Jun 21 10:37:45.428810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 139/264] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:37:45.487799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:45.488634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:45.492165 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:45.510906 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:45.513468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:45.516455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:45.519672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:45.962901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:45.963623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:45.983458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:45.983905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:45.984905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:45.985346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.047602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:46.074731 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9eacacda-0831-43f1-93ca-02052ead29d5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.586878 Jun 21 10:37:46.076796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 126/265] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:45 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:46.102404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:46.106881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:46.133473 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:46.134270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.137402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:46.137639 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.249897 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:46.259904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0b207fe8-2ebe-4011-810e-37c297bc57a3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.301536 Jun 21 10:37:46.263978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 140/266] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:45 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:46.287265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:46.300218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-072adb49-e6cc-4902-994e-a7868b13ea3d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1272 microversion: 2.1 time: 0.207464 Jun 21 10:37:46.301046 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 127/267] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:46 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:46.374933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:46.376667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:46.386926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:46.387676 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.388923 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:46.389762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.435187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:46.435791 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:46.436032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lazy-loading 'fault' on Instance uuid b27ba21f-6661-4761-8ee2-b0c85ba56fad {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:37:46.492429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:46.513286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a04941f5-d1db-4954-875c-d496298b8e6c tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1351 microversion: 2.1 time: 0.142719 Jun 21 10:37:46.516821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 141/268] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:46 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:47.110318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:47.111303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:47.119740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.120597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.121824 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.122509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.298287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:47.299819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:47.316788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.318365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.328031 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.331703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.471086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:47.485506 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2b79a784-3175-488e-9770-cde55b655923 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.381913 Jun 21 10:37:47.486464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 128/269] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:47 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:47.492749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:47.494331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:47.544169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.544169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.544169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.544169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.742107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:47.784067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-11bd7ab7-d961-4c36-87bc-349f4294a8ab tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.493569 Jun 21 10:37:47.791502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 142/270] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:47 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:47.831193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-b3d72797-7679-419a-900b-7ef251ebc052 req-a28e386e-a2df-43d9-ab7f-dd518d1f5bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0f562e-5888-4fcd-ab20-f4bda698a198", "tag": "832d4cbc-3c2d-470f-b9b4-cbecad9a519e"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:47.869902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b3d72797-7679-419a-900b-7ef251ebc052 req-a28e386e-a2df-43d9-ab7f-dd518d1f5bca service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.870398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b3d72797-7679-419a-900b-7ef251ebc052 req-a28e386e-a2df-43d9-ab7f-dd518d1f5bca service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.889450 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-b3d72797-7679-419a-900b-7ef251ebc052 req-a28e386e-a2df-43d9-ab7f-dd518d1f5bca service nova] Creating event network-changed:832d4cbc-3c2d-470f-b9b4-cbecad9a519e for instance ce0f562e-5888-4fcd-ab20-f4bda698a198 on hv-cinder-83697 Jun 21 10:37:47.902231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-b3d72797-7679-419a-900b-7ef251ebc052 req-a28e386e-a2df-43d9-ab7f-dd518d1f5bca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107044 Jun 21 10:37:47.903007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 143/271] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:37:47.909510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:47.910257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:47.918154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.918614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.919404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.921083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.968759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:47.969093 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:47.969730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lazy-loading 'fault' on Instance uuid b27ba21f-6661-4761-8ee2-b0c85ba56fad {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:37:48.040559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:48.059001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a6c87dbcb41eba4597f8a16651ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76f6f1219f94a24b5015fb819a67ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:48.063079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cf4e16c7-80c7-4e09-9ea9-acf1989b425b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.575294 Jun 21 10:37:48.063930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 129/272] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:47 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:48.083110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7b0782b5-7624-476a-b935-111beb99f7c6 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 200 len: 1351 microversion: 2.1 time: 0.176377 Jun 21 10:37:48.085487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 144/273] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:47 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 1351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:48.518550 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:48.519869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:48.530039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:48.530925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:48.532320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:48.533090 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:48.819652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:48.821853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:48.844509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:48.853991 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:48.854809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:48.859511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:48.860454 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:48.889766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-12674eda-020f-4c32-b19b-8ba8670c946a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.374770 Jun 21 10:37:48.905665 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 130/274] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:48 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:49.085491 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:49.089439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:49.123196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.126900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.128764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.132736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.295825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:49.300292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:49.307615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0c0076ec-6ea7-4c94-a08f-e818b62f2f1f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.497419 Jun 21 10:37:49.308648 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 145/275] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:48 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:49.315019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:49.316023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:49.325081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.325910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.326456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.326892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.346128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] HTTP exception thrown: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Request method failure captured: Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad HTTP/1.1 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ8B0vUK5GFmSYFIfZ05kBXKGOha48w-8lXCjWqE1s3C3z-6cxL5Xl3lLlnwR4RSYcJ8FC6_bEpv7H_z4cK0u2b09-aF4Q4TObj1TQXpPECA7XYdA9RL5gPTXd9KckfONMOqWDJxtTxwLCbTlxlakxU2rX9uX8hZHlpObKy0fGuDQzc Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:37:49.353174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b76f6f1219f94a24b5015fb819a67ed6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b76f6f1219f94a24b5015fb819a67ed6"}]}] Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 5a3a6c87dbcb41eba4597f8a16651ecc Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.355774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'b27ba21f-6661-4761-8ee2-b0c85ba56fad'} Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:37:49.357802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.361925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.364319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Returning 404 to user: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:37:49.364319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc2541c8-1f07-4707-af60-c885d6fe2ffa tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 404 len: 111 microversion: 2.1 time: 0.045358 Jun 21 10:37:49.364319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 146/276] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:49 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:37:49.502328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:49.504307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:49.505518 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:49.525914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.528592 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.530507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e203f641-870d-49be-b18f-88fa64c48865 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.447246 Jun 21 10:37:49.532052 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 131/277] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:49 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:49.532826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.535006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.568463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] HTTP exception thrown: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Request method failure captured: Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad/os-volume_attachments HTTP/1.1 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ8B0vUK5GFmSYFIfZ05kBXKGOha48w-8lXCjWqE1s3C3z-6cxL5Xl3lLlnwR4RSYcJ8FC6_bEpv7H_z4cK0u2b09-aF4Q4TObj1TQXpPECA7XYdA9RL5gPTXd9KckfONMOqWDJxtTxwLCbTlxlakxU2rX9uX8hZHlpObKy0fGuDQzc Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:37:49.573782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b76f6f1219f94a24b5015fb819a67ed6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b76f6f1219f94a24b5015fb819a67ed6"}]}] Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 5a3a6c87dbcb41eba4597f8a16651ecc Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.576223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'server_id': 'b27ba21f-6661-4761-8ee2-b0c85ba56fad'} Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:37:49.577511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:49.583361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:49.592384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Returning 404 to user: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:37:49.592384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a38d004-1378-490e-b8f3-b411f3ef9628 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079234 Jun 21 10:37:49.592384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 147/278] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:37:49 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad/os-volume_attachments => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:37:49.912152 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:49.913019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:49.923091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.923677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.927295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.927709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.941529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5c8ace0d-aedb-4be4-8bdd-7ebf259c687e req-3d4da952-a291-4e96-8b42-e84ca3ececc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daaa97d-1951-470a-9336-beb446956e88", "tag": "fdb2cbaa-09b3-4df4-b19c-f996bae6649a"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:49.973674 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5c8ace0d-aedb-4be4-8bdd-7ebf259c687e req-3d4da952-a291-4e96-8b42-e84ca3ececc7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:49.974798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5c8ace0d-aedb-4be4-8bdd-7ebf259c687e req-3d4da952-a291-4e96-8b42-e84ca3ececc7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:49.990045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5c8ace0d-aedb-4be4-8bdd-7ebf259c687e req-3d4da952-a291-4e96-8b42-e84ca3ececc7 service nova] Creating event network-changed:fdb2cbaa-09b3-4df4-b19c-f996bae6649a for instance 6daaa97d-1951-470a-9336-beb446956e88 on hv-cinder-83697 Jun 21 10:37:49.999480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5c8ace0d-aedb-4be4-8bdd-7ebf259c687e req-3d4da952-a291-4e96-8b42-e84ca3ececc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073068 Jun 21 10:37:50.000744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 148/279] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:37:50.185359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:50.195334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8d2c210c-369f-49a7-8b2b-0e07564b13ef tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.287701 Jun 21 10:37:50.195938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 132/280] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:49 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:50.329584 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:50.330673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:50.340987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.341744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:50.343182 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.343941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:50.563295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:50.565595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:50.572049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=4 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:50.573808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=12 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:50.583861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.585436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:50.587080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.587937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:50.672757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:50.683014 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31d71706-1c6a-43e2-8d2b-6f93a495e34e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.360188 Jun 21 10:37:50.683930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 149/281] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:50 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:50.849911 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:50.865030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-316ebcb1-9a25-4625-9ea4-99de9a328b2c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.310177 Jun 21 10:37:50.869176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 133/282] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:50 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:50.969908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:50.976756 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:50.977569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:50.991100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.992252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:50.994736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:50.996010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.028570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] HTTP exception thrown: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Request method failure captured: Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad HTTP/1.1 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ8B0vUK5GFmSYFIfZ05kBXKGOha48w-8lXCjWqE1s3C3z-6cxL5Xl3lLlnwR4RSYcJ8FC6_bEpv7H_z4cK0u2b09-aF4Q4TObj1TQXpPECA7XYdA9RL5gPTXd9KckfONMOqWDJxtTxwLCbTlxlakxU2rX9uX8hZHlpObKy0fGuDQzc Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:37:51.030878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b76f6f1219f94a24b5015fb819a67ed6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b76f6f1219f94a24b5015fb819a67ed6"}]}] Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 5a3a6c87dbcb41eba4597f8a16651ecc Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.033723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'b27ba21f-6661-4761-8ee2-b0c85ba56fad'} Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:37:51.035254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.037283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.039552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Returning 404 to user: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:37:51.039552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b6552565-47a3-474b-a5df-4b812b69c982 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 404 len: 111 microversion: 2.1 time: 0.064535 Jun 21 10:37:51.039552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 150/283] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:37:50 2022] DELETE /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:37:51.047691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:51.049002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] [instance: b27ba21f-6661-4761-8ee2-b0c85ba56fad] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:51.063460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.064526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.065924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.067036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.091211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] HTTP exception thrown: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Request method failure captured: Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad HTTP/1.1 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ8B0vUK5GFmSYFIfZ05kBXKGOha48w-8lXCjWqE1s3C3z-6cxL5Xl3lLlnwR4RSYcJ8FC6_bEpv7H_z4cK0u2b09-aF4Q4TObj1TQXpPECA7XYdA9RL5gPTXd9KckfONMOqWDJxtTxwLCbTlxlakxU2rX9uX8hZHlpObKy0fGuDQzc Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:37:51.100213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b76f6f1219f94a24b5015fb819a67ed6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b76f6f1219f94a24b5015fb819a67ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b76f6f1219f94a24b5015fb819a67ed6"}]}] Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: b76f6f1219f94a24b5015fb819a67ed6 Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-DeleteServersTestJSON-1942891079 Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 5a3a6c87dbcb41eba4597f8a16651ecc Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-DeleteServersTestJSON-1942891079-project Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.106391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'b27ba21f-6661-4761-8ee2-b0c85ba56fad'} Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:37:51.107705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. Jun 21 10:37:51.110043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:37:51.112316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] Returning 404 to user: Instance b27ba21f-6661-4761-8ee2-b0c85ba56fad could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:37:51.112316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d206efdf-4017-4780-83d4-d1939d3550f8 tempest-DeleteServersTestJSON-1942891079 tempest-DeleteServersTestJSON-1942891079-project] 10.222.0.43 "GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad" status: 404 len: 111 microversion: 2.1 time: 0.059542 Jun 21 10:37:51.112316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 134/284] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:51 2022] GET /compute/v2.1/servers/b27ba21f-6661-4761-8ee2-b0c85ba56fad => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:37:51.222022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:51.223107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:51.237138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.237958 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.240138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.241027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.695573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:51.709204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:51.710931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:51.725194 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.726040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.727667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.728691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.731332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c44d78c0-06d0-4c9e-87b7-b76392dc1970 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 0.516813 Jun 21 10:37:51.734924 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 151/285] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:51 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:51.896522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:51.899692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:51.918897 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.920560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:51.935699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:51.937290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:52.083739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:52.097151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5310b2d5-8c70-40e5-8b0e-978a88150e1e tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.398243 Jun 21 10:37:52.102106 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 135/286] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:51 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:52.294846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:52.321734 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cac88b10-d3a1-403f-9a10-191b4371fd0b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.435715 Jun 21 10:37:52.323161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 152/287] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:51 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:52.761817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:52.762868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:52.787970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:52.788776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:52.791193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:52.794211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:53.124416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:53.125247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:53.141378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:53.145485 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:53.146681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:53.147389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:53.494029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:53.514659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7ef9bab4-c658-4774-8f8f-d8dca02d7ef4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.394081 Jun 21 10:37:53.516823 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 153/288] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:53 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:53.535089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:53.537061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:53.550634 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:53.552103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:53.555195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:53.557609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:53.846704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:53.857707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4b8caee5-2206-46f5-b5ed-0abca037c5aa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.339083 Jun 21 10:37:53.858516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 154/289] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:53 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:54.223276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:54.249151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b9e180ff-66fa-41c2-88d8-e074fed70063 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1521 microversion: 2.1 time: 1.493717 Jun 21 10:37:54.254790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 136/290] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:52 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1521 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:54.537179 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:54.539318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:54.551291 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:54.551935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:54.553268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:54.554469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:54.879294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:54.881877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:54.893577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:54.895049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:54.897600 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:54.899031 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.079510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:55.100230 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-77005613-f9f6-4321-b303-7ebd8d6fd693 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.570029 Jun 21 10:37:55.101382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 155/291] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:54 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:55.289061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:55.290527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:55.318303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:55.320161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.321184 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:55.321943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.613358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:55.628655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ca98e3ea-9897-4690-a569-4ce8d360aea4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1501 microversion: 2.1 time: 0.348325 Jun 21 10:37:55.630894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 156/292] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:55 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:55.640945 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-7d002048-930f-46f0-855e-d60e03257464 req-39fcc5cd-bc36-4f20-8eb8-eb6a7dc75692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0f562e-5888-4fcd-ab20-f4bda698a198", "name": "network-vif-plugged", "status": "completed", "tag": "832d4cbc-3c2d-470f-b9b4-cbecad9a519e"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:55.654821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7d002048-930f-46f0-855e-d60e03257464 req-39fcc5cd-bc36-4f20-8eb8-eb6a7dc75692 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:55.658368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7d002048-930f-46f0-855e-d60e03257464 req-39fcc5cd-bc36-4f20-8eb8-eb6a7dc75692 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.674862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-7d002048-930f-46f0-855e-d60e03257464 req-39fcc5cd-bc36-4f20-8eb8-eb6a7dc75692 service nova] Creating event network-vif-plugged:832d4cbc-3c2d-470f-b9b4-cbecad9a519e for instance ce0f562e-5888-4fcd-ab20-f4bda698a198 on hv-cinder-83697 Jun 21 10:37:55.683262 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-7d002048-930f-46f0-855e-d60e03257464 req-39fcc5cd-bc36-4f20-8eb8-eb6a7dc75692 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048293 Jun 21 10:37:55.685492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 157/293] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:37:55.693147 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:55.694226 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:55.701648 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:55.702129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.703436 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:55.703436 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:55.756483 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:55.792969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-22c0d36f-ef9d-4f0d-a776-57537491bc5b tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.920163 Jun 21 10:37:55.795630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 137/294] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:54 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:37:55.923141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:55.938168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c9de5f2e-5757-46ba-827a-5c830916d941 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1515 microversion: 2.1 time: 0.250875 Jun 21 10:37:55.950091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 158/295] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:55 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:56.131142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:56.133243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:56.145461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:56.145891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:56.146789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:56.147601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:56.475643 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:56.511804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-30ae713a-1f47-4935-b4b4-7cc0344628d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.375952 Jun 21 10:37:56.514203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 138/296] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:56 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:56.816754 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:56.820490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:56.836417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:56.837124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:56.838138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:56.838679 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:57.323210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:57.337439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-71eb43e7-4ddb-4c5d-ad78-29883f4317ac tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.528633 Jun 21 10:37:57.338042 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 159/297] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:56 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:57.545363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:57.546809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:57.570855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:57.571831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:57.573105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:57.573812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:57.772571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:37:57.774267 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:57.781950 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:57.782980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:57.784050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:57.784733 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:57.821419 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:57.825649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lazy-loading 'flavor' on Instance uuid fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:37:57.858043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d36f06ab-3446-4f14-b1fc-80c92066b177 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.319124 Jun 21 10:37:57.861361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 139/298] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:57 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:58.018785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a0a43ee-b65a-49b8-9be6-a27f749c011b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/action" status: 200 len: 32 microversion: 2.1 time: 0.250926 Jun 21 10:37:58.020381 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 160/299] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:37:57 2022] POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:37:58.039759 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:58.040896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:58.052854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.054710 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:58.056201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.056964 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:58.363332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:58.365689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:58.378412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.379365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:58.381138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.381875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:58.476288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:58.497793 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dce31adc-23d1-4393-b493-a304aac003a4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.468572 Jun 21 10:37:58.506544 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 140/300] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:58 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:58.884458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:58.887217 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:58.940084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.940970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:58.945951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:58.954607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:59.331567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:59.346197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b6aa0cc5-3343-4015-9fa3-b164124fe45c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.989424 Jun 21 10:37:59.346969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 161/301] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:58 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:37:59.521189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:37:59.522448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:37:59.540042 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:59.541009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:59.542105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:37:59.542813 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:37:59.552248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:37:59.560788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:59.584125 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c8a2d995-521d-4b01-be62-87132b8d3d83 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.706700 Jun 21 10:37:59.586800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 141/302] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:58 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:00.036223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:00.051903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0884ee67-30a6-450c-b31d-608ccd16650b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.536203 Jun 21 10:38:00.053586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 162/303] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:37:59 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:00.368291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:00.369215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:00.382508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:00.383328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:00.384997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:00.385672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:00.608243 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:00.609353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:00.634280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:00.636228 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:00.638969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:00.640345 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:00.969932 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:00.976263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:00.987614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4bdb8903-10c9-4505-b551-82424c682fbb tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1317 microversion: 2.1 time: 0.385700 Jun 21 10:38:00.989008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 163/304] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:00 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:01.077474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:01.078246 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:01.095892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:01.096393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:01.100413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:01.100886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:01.376284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:01.388157 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7d3ac6df-d03e-41d8-ab0f-79609f288f96 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 1.027764 Jun 21 10:38:01.399966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 142/305] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:00 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:01.649000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:01.664137 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ef40c315-6f8f-48a9-b2a8-f2d7c77140a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.590761 Jun 21 10:38:01.665241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 164/306] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:01 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:02.010381 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:02.011719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:02.032791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:02.033775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:02.035514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:02.036741 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:02.455787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a5ce6f4a-87ef-42ab-b62c-6efa3dab55a7 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Action: 'create', calling method: .version_select at 0x7f8a361329d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1603856438"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:02.541316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:02.606656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f2dca468-f1a3-4163-a7f8-8dd5d6b4088b tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1507 microversion: 2.1 time: 0.602741 Jun 21 10:38:02.607826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 143/307] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:02 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:02.642206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:02.643590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:02.658527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:02.659781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:02.661804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:02.663159 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:03.041893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:03.050444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3ec85c01-a180-4dd8-94c5-e89be030efcc tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.429871 Jun 21 10:38:03.063931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 144/308] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:02 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:03.074541 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-4e4de7fc-8643-41fb-b938-17a5d135c3af req-0b878975-bb87-41f9-9133-49aa37075965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daaa97d-1951-470a-9336-beb446956e88", "name": "network-vif-plugged", "status": "completed", "tag": "fdb2cbaa-09b3-4df4-b19c-f996bae6649a"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:03.101744 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-4e4de7fc-8643-41fb-b938-17a5d135c3af req-0b878975-bb87-41f9-9133-49aa37075965 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:03.102238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-4e4de7fc-8643-41fb-b938-17a5d135c3af req-0b878975-bb87-41f9-9133-49aa37075965 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:03.107076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a5ce6f4a-87ef-42ab-b62c-6efa3dab55a7 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.977821 Jun 21 10:38:03.108183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 165/309] 10.222.0.43 () {60 vars in 1154 bytes} [Tue Jun 21 10:38:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 981 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 10:38:03.113369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:03.114022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:03.131028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:03.132980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:03.135067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:03.136821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:03.156744 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-4e4de7fc-8643-41fb-b938-17a5d135c3af req-0b878975-bb87-41f9-9133-49aa37075965 service nova] Creating event network-vif-plugged:fdb2cbaa-09b3-4df4-b19c-f996bae6649a for instance 6daaa97d-1951-470a-9336-beb446956e88 on hv-cinder-83697 Jun 21 10:38:03.175740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-4e4de7fc-8643-41fb-b938-17a5d135c3af req-0b878975-bb87-41f9-9133-49aa37075965 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109558 Jun 21 10:38:03.176380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 145/310] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:03.199266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0b5995d5-e036-45d8-94b2-2dd7252cc183 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a3674ff70>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:03.367272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:03.379755 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-90b0c20f-0858-4886-b3a4-d9f0c352499f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.270396 Jun 21 10:38:03.380657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 166/311] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:03 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:03.515491 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0b5995d5-e036-45d8-94b2-2dd7252cc183 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 200 len: 345 microversion: 2.1 time: 0.337515 Jun 21 10:38:03.519744 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 146/312] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:03 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:04.082122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.083342 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:04.097808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:04.098632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:04.100801 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:04.102897 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:04.321651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:04.330091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-804cd02e-d420-4099-8f5a-2aef442488d9 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.261964 Jun 21 10:38:04.330683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 167/313] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:04.399982 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.400755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:04.409378 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:04.409998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:04.410891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:04.411450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:04.535747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-973b59cd-66c6-4e27-bee2-94f99cbdcbda tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a361fa310>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.568620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:04.578094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d515c415-ab0a-4e5c-94d4-07af24ab61a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.183254 Jun 21 10:38:04.579273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 147/314] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:04.603309 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-973b59cd-66c6-4e27-bee2-94f99cbdcbda tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 200 len: 346 microversion: 2.1 time: 0.071562 Jun 21 10:38:04.604481 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 168/315] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:04.616819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1156b0c9-8065-4e1f-b7fb-3f5f18a0e75e tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Action: 'create', calling method: .version_select at 0x7f8a3674f550>, body: {"snapshot": {"volume_id": "482fd710-fd5f-46ef-943f-2e8991fc63b8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-893421032"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:04.840863 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1156b0c9-8065-4e1f-b7fb-3f5f18a0e75e tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.227877 Jun 21 10:38:04.841873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 148/316] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Jun 21 10:38:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:04.857027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c2c90c03-25fa-4d3b-b6c9-9fc8bddbe171 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a360ea790>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.895803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c2c90c03-25fa-4d3b-b6c9-9fc8bddbe171 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.044077 Jun 21 10:38:04.896657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 169/317] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:04.911714 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-67093940-eef3-4bd6-af0f-68b5ecc521d8 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a368ceee0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.950103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-67093940-eef3-4bd6-af0f-68b5ecc521d8 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046391 Jun 21 10:38:04.950689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 149/318] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:04.962724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9a03eb6c-078e-41b9-8e60-afaf36277644 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a361dc940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:04.996843 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9a03eb6c-078e-41b9-8e60-afaf36277644 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.038341 Jun 21 10:38:04.997426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 170/319] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:04 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:38:05.351054 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:05.352663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:05.365027 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:05.366010 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:05.367528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:05.368117 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:05.553339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:05.562272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8d044037-9f21-4fec-9f1f-b67c3a054ec4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1314 microversion: 2.1 time: 0.218658 Jun 21 10:38:05.562900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 150/320] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:05 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:05.600798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:05.601486 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:05.608536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:05.608970 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:05.609936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:05.610402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:05.790540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:05.805963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c5dd4477-92a8-46f5-bdac-1c83c09c9436 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.209510 Jun 21 10:38:05.807007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 171/321] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:05 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:06.010674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1001f9b9-03da-4656-b72e-4e03daf1b2a2 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a3674f940>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:06.053683 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1001f9b9-03da-4656-b72e-4e03daf1b2a2 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.048292 Jun 21 10:38:06.054834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 151/322] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:06 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:06.593521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:06.595248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:06.611535 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:06.612349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:06.613943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:06.614560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:06.778361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:06.793189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-40f13f8f-3f09-4de5-975f-4800e98f74fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1497 microversion: 2.1 time: 0.216238 Jun 21 10:38:06.794216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 172/323] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:06 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:06.829991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:06.831523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:06.842402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:06.843276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:06.844725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:06.845578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:07.009405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:07.018403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-845388de-3ad5-4024-aac4-617a88c3090b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.196654 Jun 21 10:38:07.019183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 152/324] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:06 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:07.065797 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f73b28a3-c78d-4868-9387-8a14b24f2102 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a360eaaf0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:07.099553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f73b28a3-c78d-4868-9387-8a14b24f2102 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.037586 Jun 21 10:38:07.100745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 173/325] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:07 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:08.037321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:08.037936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:08.045074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:08.045523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:08.046349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:08.046791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:08.113712 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dfaafc9e-c91b-4d50-b3d2-d783c7b3f172 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a361fa790>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:08.150160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dfaafc9e-c91b-4d50-b3d2-d783c7b3f172 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.041351 Jun 21 10:38:08.150934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 174/326] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:08 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:38:08.223188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:08.231759 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-de6a41e2-f0f6-48c0-a6c3-58299ab2e576 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.198598 Jun 21 10:38:08.232366 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 153/327] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:08 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:09.163585 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c7ffaa18-920b-435d-a3d3-66397b93c5f3 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a38649dc0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:09.197120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c7ffaa18-920b-435d-a3d3-66397b93c5f3 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.037591 Jun 21 10:38:09.198180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 175/328] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:09 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:09.248890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:09.249492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:09.256597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:09.257089 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:09.257872 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:09.258347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:09.435190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:09.443523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-32a3cdda-4ed6-459a-8b32-b75bfdfee5a2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.198447 Jun 21 10:38:09.444113 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 154/329] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:09 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:10.211024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bfdd6bde-372a-4903-a901-574c38c20293 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a3623c9d0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:10.245132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bfdd6bde-372a-4903-a901-574c38c20293 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.039034 Jun 21 10:38:10.245721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 176/330] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:10 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:38:10.461446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:10.462000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:10.468917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:10.469357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:10.470156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:10.470590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:10.640860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:10.649386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-73bf22db-a8f6-444a-9de8-56511f53185e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.192116 Jun 21 10:38:10.649966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 155/331] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:10 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:11.260113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c25eadb9-cee4-4233-97c6-adfab5caaf04 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a361dc9d0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.294540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c25eadb9-cee4-4233-97c6-adfab5caaf04 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 287 microversion: 2.1 time: 0.039119 Jun 21 10:38:11.295250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 177/332] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:11 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:11.308094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b1638379-a49a-44ae-854e-359035390063 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a36753820>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.376857 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b1638379-a49a-44ae-854e-359035390063 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 202 len: 0 microversion: 2.1 time: 0.074073 Jun 21 10:38:11.377946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 156/333] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jun 21 10:38:11 2022] DELETE /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:38:11.391736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c1771e37-88bd-40ec-8003-8cfddede0848 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a35fb8af0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.432194 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c1771e37-88bd-40ec-8003-8cfddede0848 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 200 len: 286 microversion: 2.1 time: 0.047415 Jun 21 10:38:11.432769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 178/334] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:11 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:11.668586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.669492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:11.675713 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.676158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:11.676934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.677369 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:11.749616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.750029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:11.752367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=86 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:11.759457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.759907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:11.760708 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.761183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:11.789893 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:38:11.863295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:11.878288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2d650331-5c4a-44ea-87cc-46a097775d97 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.213985 Jun 21 10:38:11.880384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 157/335] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:11 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:11.904402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4564803e-dbc1-4636-ae7f-099dc03d658a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 204 len: 0 microversion: 2.1 time: 0.158351 Jun 21 10:38:11.905939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 179/336] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:38:11 2022] DELETE /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:38:11.916754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:11.917362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:11.924965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.925413 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:11.926308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:11.926742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:12.142487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:12.154909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4773b974-d9da-4382-8136-dc7088eab2cb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1503 microversion: 2.1 time: 0.241637 Jun 21 10:38:12.157835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 158/337] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:11 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:12.448158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-480ca4b3-4be4-44e1-a037-d797cf232601 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a361dc940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:12.478131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-480ca4b3-4be4-44e1-a037-d797cf232601 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] HTTP exception thrown: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-480ca4b3-4be4-44e1-a037-d797cf232601 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Request method failure captured: Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 HTTP/1.1 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ-JNC9FyWD1EOS--TqSVew7gJjhLPp_xkhAAFnJb9J0HG6vPii-Y0loVVueE3MA49RqeY_njn1IZ4qBxfQBjvPHODcO5aSYbmni3f3oGkaM3iiIbqAnNEocOZCVDF_qLA9x4tgO957cj_3K7otCCIJ4xvx6SXW0SedSpNJsH5sXiV4 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:38:12.484476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d45d0abe324c4bfe96658885be4430a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d45d0abe324c4bfe96658885be4430a3"}]}] Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 8bda78d72760411c98ba8e2d358999a9 Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '6eec3dd0-9b51-40ab-9a75-e552d3b33678'} Jun 21 10:38:12.486170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. (HTTP 404) (Request-ID: req-99f36c2c-ca43-4c1b-a785-056cc5585e1e) Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.487195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:12.488545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 10:38:12.489978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-480ca4b3-4be4-44e1-a037-d797cf232601 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Returning 404 to user: Snapshot 6eec3dd0-9b51-40ab-9a75-e552d3b33678 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-480ca4b3-4be4-44e1-a037-d797cf232601 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678" status: 404 len: 111 microversion: 2.1 time: 0.043381 Jun 21 10:38:12.491890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 180/338] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:38:12 2022] GET /compute/v2.1/os-snapshots/6eec3dd0-9b51-40ab-9a75-e552d3b33678 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:38:12.497765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cedf4e79-50dc-48ae-8c5d-dc7b97b7110d tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a368c3a60>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:12.564851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cedf4e79-50dc-48ae-8c5d-dc7b97b7110d tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 202 len: 0 microversion: 2.1 time: 0.071271 Jun 21 10:38:12.565425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 159/339] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:38:12 2022] DELETE /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:38:12.575936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f42a3de2-e843-4bde-a78d-179ca19ba1c8 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a3625edc0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:12.631405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f42a3de2-e843-4bde-a78d-179ca19ba1c8 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 200 len: 345 microversion: 2.1 time: 0.060418 Jun 21 10:38:12.632081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 181/340] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:12 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:38:12.904881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:12.905946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:12.917767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:12.918552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:12.919868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:12.920600 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:13.100532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:13.109504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e4a65823-ed37-4c43-ac7d-4fba7a7849e5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.214378 Jun 21 10:38:13.110123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 160/341] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:12 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:13.177916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:13.179382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:13.192005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:13.192824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:13.195247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:13.195744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:13.376686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:13.388887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b44c52c1-84f4-4f6c-a074-4abe5755e582 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1503 microversion: 2.1 time: 0.218013 Jun 21 10:38:13.389916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 182/342] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:13 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:13.648827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-574a0a6f-63a9-467b-b8af-456ebd3c5e9f tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a3830e8b0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:13.710935 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-574a0a6f-63a9-467b-b8af-456ebd3c5e9f tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 200 len: 345 microversion: 2.1 time: 0.067806 Jun 21 10:38:13.711480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 161/343] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:13 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:14.130747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:14.132099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:14.138399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:14.138849 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:14.139649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:14.140078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:14.322619 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:14.331157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-56e95c55-80d6-4b7d-9b00-21cb09fd87d9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.204906 Jun 21 10:38:14.331840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 183/344] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:14 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:14.407097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:14.407812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:14.414368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:14.414968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:14.415592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:14.416028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:14.726730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3a053375-f68f-467f-8f24-05dcca70854a tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a386494c0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:14.737791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:14.748794 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ce83d0aa-44cf-45d6-95ed-f331ddb4e59c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 200 len: 1503 microversion: 2.1 time: 0.346086 Jun 21 10:38:14.750042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 162/345] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:14 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:14.756565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-a39d0d1e-7ec5-4551-b78d-9084b6200b28 req-9d7d2356-5e66-4375-b7e3-2f4237f716bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daaa97d-1951-470a-9336-beb446956e88", "name": "network-vif-deleted", "tag": "fdb2cbaa-09b3-4df4-b19c-f996bae6649a"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:14.767009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a39d0d1e-7ec5-4551-b78d-9084b6200b28 req-9d7d2356-5e66-4375-b7e3-2f4237f716bc service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:14.767607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a39d0d1e-7ec5-4551-b78d-9084b6200b28 req-9d7d2356-5e66-4375-b7e3-2f4237f716bc service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:14.794002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-a39d0d1e-7ec5-4551-b78d-9084b6200b28 req-9d7d2356-5e66-4375-b7e3-2f4237f716bc service nova] Creating event network-vif-deleted:fdb2cbaa-09b3-4df4-b19c-f996bae6649a for instance 6daaa97d-1951-470a-9336-beb446956e88 on hv-cinder-83697 Jun 21 10:38:14.804354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-a39d0d1e-7ec5-4551-b78d-9084b6200b28 req-9d7d2356-5e66-4375-b7e3-2f4237f716bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051938 Jun 21 10:38:14.805464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 163/346] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:14.838418 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-3a053375-f68f-467f-8f24-05dcca70854a tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] HTTP exception thrown: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3a053375-f68f-467f-8f24-05dcca70854a tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Request method failure captured: Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 HTTP/1.1 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ-JNC9FyWD1EOS--TqSVew7gJjhLPp_xkhAAFnJb9J0HG6vPii-Y0loVVueE3MA49RqeY_njn1IZ4qBxfQBjvPHODcO5aSYbmni3f3oGkaM3iiIbqAnNEocOZCVDF_qLA9x4tgO957cj_3K7otCCIJ4xvx6SXW0SedSpNJsH5sXiV4 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:38:14.845163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d45d0abe324c4bfe96658885be4430a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d45d0abe324c4bfe96658885be4430a3"}]}] Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 8bda78d72760411c98ba8e2d358999a9 Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '482fd710-fd5f-46ef-943f-2e8991fc63b8'} Jun 21 10:38:14.847745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. (HTTP 404) (Request-ID: req-656a1bee-bd41-4938-90a9-7eae4f14288b) Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.849180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:14.853421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:38:14.859949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3a053375-f68f-467f-8f24-05dcca70854a tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Returning 404 to user: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:14.864347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3a053375-f68f-467f-8f24-05dcca70854a tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 404 len: 109 microversion: 2.1 time: 0.126855 Jun 21 10:38:14.884586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 184/347] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:14 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:38:14.890537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1d11f37e-ee15-49e6-a35f-775685141681 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a368c3b80>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:14.976673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-1d11f37e-ee15-49e6-a35f-775685141681 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] HTTP exception thrown: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1d11f37e-ee15-49e6-a35f-775685141681 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Request method failure captured: Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 HTTP/1.1 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ-JNC9FyWD1EOS--TqSVew7gJjhLPp_xkhAAFnJb9J0HG6vPii-Y0loVVueE3MA49RqeY_njn1IZ4qBxfQBjvPHODcO5aSYbmni3f3oGkaM3iiIbqAnNEocOZCVDF_qLA9x4tgO957cj_3K7otCCIJ4xvx6SXW0SedSpNJsH5sXiV4 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:38:14.982264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d45d0abe324c4bfe96658885be4430a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d45d0abe324c4bfe96658885be4430a3"}]}] Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 8bda78d72760411c98ba8e2d358999a9 Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '482fd710-fd5f-46ef-943f-2e8991fc63b8'} Jun 21 10:38:14.983788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. (HTTP 404) (Request-ID: req-a7746a0d-a846-4293-aeb2-ac39bef2ee0e) Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.984677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:38:14.985993 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:38:14.987586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:14.988895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:14.992474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1d11f37e-ee15-49e6-a35f-775685141681 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Returning 404 to user: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:14.998279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1d11f37e-ee15-49e6-a35f-775685141681 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 404 len: 109 microversion: 2.1 time: 0.122798 Jun 21 10:38:15.000292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 164/348] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:38:14 2022] DELETE /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:38:15.021915 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-68a09228-67b4-43ac-ba52-5ea268b62534 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Calling method '.version_select at 0x7f8a35f91160>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:15.065620 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-68a09228-67b4-43ac-ba52-5ea268b62534 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] HTTP exception thrown: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-68a09228-67b4-43ac-ba52-5ea268b62534 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Request method failure captured: Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 HTTP/1.1 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ-JNC9FyWD1EOS--TqSVew7gJjhLPp_xkhAAFnJb9J0HG6vPii-Y0loVVueE3MA49RqeY_njn1IZ4qBxfQBjvPHODcO5aSYbmni3f3oGkaM3iiIbqAnNEocOZCVDF_qLA9x4tgO957cj_3K7otCCIJ4xvx6SXW0SedSpNJsH5sXiV4 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:38:15.069116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d45d0abe324c4bfe96658885be4430a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d45d0abe324c4bfe96658885be4430a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d45d0abe324c4bfe96658885be4430a3"}]}] Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: d45d0abe324c4bfe96658885be4430a3 Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-293199349 Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 8bda78d72760411c98ba8e2d358999a9 Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesSnapshotsTestJSON-293199349-project Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '482fd710-fd5f-46ef-943f-2e8991fc63b8'} Jun 21 10:38:15.071193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. (HTTP 404) (Request-ID: req-36e7bbb8-45e8-45f2-9909-7cac9923c4de) Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:15.073272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:38:15.076235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:38:15.078496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-68a09228-67b4-43ac-ba52-5ea268b62534 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] Returning 404 to user: Volume 482fd710-fd5f-46ef-943f-2e8991fc63b8 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-68a09228-67b4-43ac-ba52-5ea268b62534 tempest-VolumesSnapshotsTestJSON-293199349 tempest-VolumesSnapshotsTestJSON-293199349-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8" status: 404 len: 109 microversion: 2.1 time: 0.058803 Jun 21 10:38:15.080984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 185/349] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:38:15 2022] GET /compute/v2.1/os-volumes/482fd710-fd5f-46ef-943f-2e8991fc63b8 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:38:15.353350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:15.354677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:15.366826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:15.367467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:15.368449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:15.369177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:15.573682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:15.587257 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-897a0c42-7db7-4dd8-88d0-e32d135e9874 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.242305 Jun 21 10:38:15.588220 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 165/350] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:15 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:15.776679 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:15.777678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: 6daaa97d-1951-470a-9336-beb446956e88] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:15.785344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:15.785344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:15.785753 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:15.786087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:15.806867 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] HTTP exception thrown: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Request method failure captured: Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 HTTP/1.1 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ9uIGiuB0En1h-lfsO0NmoQaAQSJha54Dfexp9yeC2Hpyw_OWQqKGkHAeqXNZIKWUJFZYwmf4z36kCEaIfwcrilNPr_Cz10uNQR8-UfoYgBgSzsy5BNjS_Ywnf12glQq-eiCH3jIWLK4t9Svdc5X9FzAGRPZku4snKLf3Zoz1Bgcb0 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b902945afee143b19beb3366841fd72d Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesActionsTest-59588677 Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:38:15.808672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b902945afee143b19beb3366841fd72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b902945afee143b19beb3366841fd72d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b902945afee143b19beb3366841fd72d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b902945afee143b19beb3366841fd72d"}]}] Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesActionsTest-59588677 Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b902945afee143b19beb3366841fd72d Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesActionsTest-59588677 Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesActionsTest-59588677-project Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 0e92ccbb22394817bd8a4224cc0d4e13 Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesActionsTest-59588677-project Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. Jun 21 10:38:15.810140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '6daaa97d-1951-470a-9336-beb446956e88'} Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:15.811292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. Jun 21 10:38:15.812663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:38:15.815015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Returning 404 to user: Instance 6daaa97d-1951-470a-9336-beb446956e88 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:15.815015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c37c3384-bb62-4fd1-97af-50c2d6d68ed8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88" status: 404 len: 111 microversion: 2.1 time: 0.039717 Jun 21 10:38:15.818257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 186/351] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:15 2022] GET /compute/v2.1/servers/6daaa97d-1951-470a-9336-beb446956e88 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:38:15.947698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1057565387", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "networks": [{"uuid": "3bcd5663-1bdd-4928-ac0f-b80363bd83f5"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:15.961086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=64 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:16.019548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] validate_networks() for [('3bcd5663-1bdd-4928-ac0f-b80363bd83f5', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:38:16.556276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:38:16.558154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:38:16.558863 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:38:16.559485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:38:16.560381 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:38:16.577339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:16.582504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:16.583574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:16.584717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:16.609581 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:16.610118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:16.627975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:16.629652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Getting quotas for project b902945afee143b19beb3366841fd72d. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:38:16.635732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:16.637828 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:16.640554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Getting quotas for user 0e92ccbb22394817bd8a4224cc0d4e13 and project b902945afee143b19beb3366841fd72d. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:38:16.640755 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:16.672803 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:38:16.675197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:38:16.772456 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4dee1faf-307a-42cb-8bd3-fbd992e61a83 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829815 Jun 21 10:38:16.779609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 166/352] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:38:16.789069 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d57a63bb-db22-4c30-b512-070f28bd0eec tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:16.789692 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d57a63bb-db22-4c30-b512-070f28bd0eec tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:16.912070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d57a63bb-db22-4c30-b512-070f28bd0eec tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:16.920856 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d57a63bb-db22-4c30-b512-070f28bd0eec tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1214 microversion: 2.1 time: 0.137717 Jun 21 10:38:16.922605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 167/353] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:16 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:16.956032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:16.971612 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ccf18c40-7a65-4f12-9e82-42b854ae230a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.366298 Jun 21 10:38:16.972955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 187/354] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:16 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:17.943389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:17.944735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:17.957008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:17.957843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:17.959158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:17.960400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:17.996393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:17.997557 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:18.011942 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:18.013918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:18.018616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:18.020481 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:18.036355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:18.046619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-73597507-6db1-4ae5-b383-4e61663b7df4 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1210 microversion: 2.1 time: 0.110080 Jun 21 10:38:18.047564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 168/355] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:17 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:18.360779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:18.384771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7ba97b37-9f8f-44d4-8d52-34b3f6890dbb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.398137 Jun 21 10:38:18.385903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 188/356] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:17 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:19.074786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:19.076213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:19.086501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:19.087232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:19.092811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:19.093591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:19.145118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:19.223782 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:19.236180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-57cf5cab-2a50-4298-9c01-8e5561861c8a tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1210 microversion: 2.1 time: 0.167271 Jun 21 10:38:19.237347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 169/357] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:19 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:19.405902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:19.407245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:19.417764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:19.418583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:19.420567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:19.420567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:19.757933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:19.769869 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c40b0832-6882-4dba-be87-284a31945873 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.369991 Jun 21 10:38:19.770998 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 189/358] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:19 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:20.265924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:20.266735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:20.278516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:20.281883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:20.284156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:20.285618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:20.383699 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:20.399408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-af193f26-4343-4f94-ab96-e2ac29001646 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1210 microversion: 2.1 time: 0.140397 Jun 21 10:38:20.400778 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 170/359] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:20 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:20.808537 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:20.810715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:20.823556 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:20.824328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:20.825984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:20.826858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:21.076523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:21.089066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-db21be48-12d1-4e23-bfd4-80897a9cfa35 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.291160 Jun 21 10:38:21.089930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 190/360] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:20 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:21.421204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:21.422347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:21.433914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:21.434659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:21.435931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:21.436629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:21.538787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:21.554807 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-04126fbb-e316-44a7-971a-0c855b494538 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1210 microversion: 2.1 time: 0.140000 Jun 21 10:38:21.555991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 171/361] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:21 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:22.117555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:22.118623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:22.133512 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:22.134337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:22.135638 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:22.136364 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:22.402367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:22.413685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4885375d-b82f-429d-9ef8-5063a020e757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.302973 Jun 21 10:38:22.414429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 191/362] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:22 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:22.577411 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:22.578225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:22.585259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:22.586093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:22.590082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:22.590656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:22.660278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:22.674751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6ac58d50-bac0-46b1-b062-066d60e909ef tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1210 microversion: 2.1 time: 0.101480 Jun 21 10:38:22.675671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 172/363] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:22 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:23.432614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:23.433565 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:23.440394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:23.440884 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:23.441665 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:23.442110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:23.673864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:23.695715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:23.696687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:23.699671 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0ec417c7-4128-4888-a466-ec6544bdd5fd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.271360 Jun 21 10:38:23.700722 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 192/364] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:23 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:23.719042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:23.722441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:23.724279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:23.725954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:23.829336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:23.841027 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-96ba0f26-34e4-4b3d-acf4-36ca54c99dc6 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1266 microversion: 2.1 time: 0.151949 Jun 21 10:38:23.841865 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 173/365] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:23 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:24.727627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:24.728438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:24.735987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:24.736425 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:24.737916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:24.738724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:24.768547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:24.864144 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:24.865690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:24.881160 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:24.882510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:24.884698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:24.885650 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:24.944540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:24.954245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e7830135-0192-4924-be31-ea977161f0e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.231496 Jun 21 10:38:24.955157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 193/366] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:24 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:25.002490 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:25.013763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-487afc43-54ab-4bd5-94b4-e058701a0632 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1274 microversion: 2.1 time: 0.157637 Jun 21 10:38:25.014650 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 174/367] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:24 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:25.985280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:25.986970 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:25.998203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:25.998977 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:26.000377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:26.000966 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:26.064597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:26.066846 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:26.085687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:26.091819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:26.093370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:26.098423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:26.288839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:26.302692 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-612bbac3-8cbe-47e7-ae24-d7bde873c862 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1274 microversion: 2.1 time: 0.264115 Jun 21 10:38:26.315039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 175/368] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:26 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:26.342799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:26.360469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-71a34159-6e32-48cf-a256-2e253958e4b8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.382215 Jun 21 10:38:26.363266 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 194/369] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:25 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:27.334777 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:27.335622 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:27.339195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:27.340209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=8 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:27.345886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:27.346448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:27.347471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:27.348075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:27.385847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:27.386440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:27.392720 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:27.393174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:27.393952 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:27.394437 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:27.527542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:27.535981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-338e373f-2d8c-455b-b5ac-bce81141922e tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.207915 Jun 21 10:38:27.537268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 176/370] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:27 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:27.568035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:27.582385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4cb3aa20-bc59-42dc-b542-3cbc8bed77cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.200039 Jun 21 10:38:27.583789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 195/371] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:27 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:28.554680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:28.555295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:28.562664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:28.563107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:28.563886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:28.564322 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:28.603030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:28.603726 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:28.610223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:28.610663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:28.613889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:28.613889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:28.703103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:28.711504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-482e3ebd-5385-4699-b8cd-78293a2965eb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.160873 Jun 21 10:38:28.712132 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 177/372] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:28 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:28.777873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:28.787331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5d0d878a-39dd-4e5a-ac0b-5feaf7535e15 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.189423 Jun 21 10:38:28.788124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 196/373] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:28 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:29.730527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:29.731237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:29.738526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:29.739030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:29.739896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:29.740382 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:29.805546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:29.806176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:29.813410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:29.814107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:29.814940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:29.815463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:29.912449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:29.920963 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4e2dc9f5-d71c-4ba2-8550-4ca5f3cb291c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.194447 Jun 21 10:38:29.921531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 178/374] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:29 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:29.973444 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:29.981846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-675372e0-5298-4890-90bd-b8875f160f46 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.180210 Jun 21 10:38:29.982448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 197/375] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:29 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:30.941027 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:30.941719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:30.949691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:30.950142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:30.950947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:30.951380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:30.999583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:31.000449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:31.007917 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:31.008581 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:31.009498 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:31.010231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:31.104189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:31.112349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1ac1770a-70ae-49e6-a18b-fcca01867c05 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.177186 Jun 21 10:38:31.112964 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 179/376] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:30 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:31.156304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:31.164456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-53452d16-3d7a-4630-a938-43c37e84feaa tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.169136 Jun 21 10:38:31.165043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 198/377] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:30 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:32.130543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:32.131593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:32.139866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:32.140667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:32.141508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:32.142129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:32.182762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:32.183566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:32.191699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:32.192190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:32.193311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:32.193420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:32.363033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:32.394399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8abb02c6-f42c-4001-9a35-cab834c9ba1b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.215553 Jun 21 10:38:32.410468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 199/378] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:32 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:32.632169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:32.641518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8ac19f8a-d341-4065-b632-6cc8ebb12eeb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.515837 Jun 21 10:38:32.642644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 180/379] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:32 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:32.882025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-f19185ba-3af5-4aab-895c-b3d68fecc421 req-7692b470-fde9-4392-b8ea-83f27f61b711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66182af-a343-4685-9fa4-66ad970a2dfe", "tag": "76dd12a6-8d22-4752-a65b-3c44611d9791"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:32.910989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f19185ba-3af5-4aab-895c-b3d68fecc421 req-7692b470-fde9-4392-b8ea-83f27f61b711 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:32.911779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f19185ba-3af5-4aab-895c-b3d68fecc421 req-7692b470-fde9-4392-b8ea-83f27f61b711 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:32.934212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-f19185ba-3af5-4aab-895c-b3d68fecc421 req-7692b470-fde9-4392-b8ea-83f27f61b711 service nova] Creating event network-changed:76dd12a6-8d22-4752-a65b-3c44611d9791 for instance a66182af-a343-4685-9fa4-66ad970a2dfe on hv-cinder-83697 Jun 21 10:38:32.942833 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-f19185ba-3af5-4aab-895c-b3d68fecc421 req-7692b470-fde9-4392-b8ea-83f27f61b711 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068239 Jun 21 10:38:32.943928 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 200/380] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:33.422522 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:33.423576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:33.431129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.431575 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.432538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.432995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.670220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:33.671949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:33.681193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.681852 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.683538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.684253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.793805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:33.805538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f145477e-8fc5-422e-a5cb-ccf0f1128e5c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1501 microversion: 2.1 time: 0.387863 Jun 21 10:38:33.807780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 181/381] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:33 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1501 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:33.829876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd3d468-e361-4409-81d5-2bd55db0be06"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:33.831444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:33.841077 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.842480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.843898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.844704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.883274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] HTTP exception thrown: Cannot 'attach_volume' instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 while it is in vm_state rescued Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Request method failure captured: Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/os-volume_attachments HTTP/1.1 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 74 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ7-0Yr6cnHx4a8u5RPb5PC0EvZ74GC7mZPWTXONMJvOammtEaSDl8VP1qqvHkM2oyVwl8AxBELJpWJ-SmV_6gjbbGrpX7otrWYhWKmBBvXupHK_hyPgmxzZ_4rUh_JL7cdJNXoz9vvEF5y5Wc94ht_61JWEMR00EFB3PMhh7fFJpvg Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:38:33.885428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ddb0def61dd452db3588952af149fb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ddb0def61dd452db3588952af149fb7"}]}] Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 9bbb5d4487874bdd9f82e28651a418f9 Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {"volumeAttachment": {"volumeId": "9fd3d468-e361-4409-81d5-2bd55db0be06"}} Jun 21 10:38:33.886912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Cannot 'attach_volume' instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 while it is in vm_state rescued Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'server_id': 'fb6ee216-79c8-4e70-b987-7cab0f5c5dd7', 'body': {'volumeAttachment': {'volumeId': '9fd3d468-e361-4409-81d5-2bd55db0be06'}}} Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:38:33.887629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 while it is in vm_state rescued Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:38:33.889036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:38:33.892728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:38:33.892728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:38:33.892728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 while it is in vm_state rescued Jun 21 10:38:33.892728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:38:33.895552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Returning 409 to user: Cannot 'attach_volume' instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 while it is in vm_state rescued {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:38:33.897137 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0e462cd3-05cc-4ba3-93c9-32003e40f757 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072829 Jun 21 10:38:33.898883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 182/382] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:38:33 2022] POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/os-volume_attachments => generated 152 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:38:33.912208 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:33.913610 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:33.922767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.923727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.925339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:33.926000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:33.926242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:33.952099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cba0f79d-98db-4f99-a613-dc0d379691f2 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.288418 Jun 21 10:38:33.954209 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 201/383] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:33 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:34.013523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5a343ad6-bac6-427b-860a-7946294e0dc2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.106380 Jun 21 10:38:34.014201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 183/384] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:38:33 2022] POST /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:38:34.028683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:34.029656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:34.040569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:34.041243 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:34.043536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:34.044752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:34.255172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:34.269773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2cfc77ca-4838-4d7d-8514-6413ed00a0c8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.248496 Jun 21 10:38:34.272254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 202/385] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:34 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:34.986120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:34.987283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:34.995962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:34.999504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:35.000985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:35.001664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:35.201859 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:35.214902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ce25201a-467a-4a59-a000-ddcf096de6d8 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.240320 Jun 21 10:38:35.215856 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 184/386] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:34 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:35.291493 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:35.292118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:35.300208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:35.300660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:35.301618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:35.302086 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:35.497594 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:35.511404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-37cc44e8-e602-4eed-87c3-32adb04ce6cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.225101 Jun 21 10:38:35.512281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 203/387] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:35 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:36.241316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:36.242869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:36.255199 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:36.256193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:36.258180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:36.259275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:36.296867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:36.462241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:36.477391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-81e043d5-802c-4870-949b-f6032c978030 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.240749 Jun 21 10:38:36.478816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 185/388] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:36 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:36.537245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:36.538021 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:36.546439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:36.547059 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:36.548130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:36.548561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:36.789426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:36.798261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-04e86880-3ed2-420b-9230-d032c887356b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.265213 Jun 21 10:38:36.798869 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 204/389] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:36 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:37.503514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:37.505003 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:37.517538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:37.518429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:37.520350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:37.522099 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:37.763063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:37.779200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e8cba1e4-801c-415c-a727-f3e8ccbb5746 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.284719 Jun 21 10:38:37.780135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 186/390] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:37 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:37.815862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:37.816352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:37.824134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:37.825192 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:37.826306 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:37.827065 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:38.012816 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:38.021926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9630b054-4ca6-4e7d-86df-3a17eec36518 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.210260 Jun 21 10:38:38.023067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 205/391] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:37 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:38.805123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:38.806201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:38.817665 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:38.818580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:38.819775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:38.820529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:39.035480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:39.039946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:39.040577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:39.047458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:39.047906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:39.050816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-63f0d91b-eef4-4dc9-9315-2762921d4e30 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.249676 Jun 21 10:38:39.051820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 187/392] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:38 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:39.063497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:39.063497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:39.277529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:39.287090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e492f6b9-9b87-42cf-b1e6-e8ba3980a38c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.251044 Jun 21 10:38:39.290098 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 206/393] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:39 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:40.082871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:40.083811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:40.099820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:40.100900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:40.102471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:40.103794 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:40.306826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:40.308102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:40.315843 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:40.316615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:40.317796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:40.318371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:40.567684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:40.582401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0c6c7bdb-0156-4681-b77b-289bc1e73800 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.280854 Jun 21 10:38:40.584397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 207/394] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:40 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:40.732849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:40.743328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3a612c7e-a77b-4955-921c-1fa485427fb5 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.669912 Jun 21 10:38:40.744305 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 188/395] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:40 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:41.608872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:41.611081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:41.629494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:41.630789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:41.632682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:41.634313 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:41.764055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:41.764795 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:41.773292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:41.774983 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:41.776050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:41.776697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:41.848119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:41.858382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3020ada2-b58d-4ca0-89b5-db95901f1ddd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.253747 Jun 21 10:38:41.859630 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 208/396] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:41 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:42.011051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:42.020399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-153e328b-c24e-47af-9029-7b8c72477aaa tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.261194 Jun 21 10:38:42.021486 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 189/397] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:41 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:42.890783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:42.895335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:42.908086 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:42.910008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:42.910787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:42.912567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:42.914094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:43.046535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:43.048598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:43.063561 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:43.065331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:43.066954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:43.068170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:43.112487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:43.125779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d8f739f-97ba-4b0b-8b95-6689ab87eb82 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.242761 Jun 21 10:38:43.126806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 209/398] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:42 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:43.396410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:43.409890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-77ebd7d9-56b2-4eff-bb37-8a570b8e1402 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.372914 Jun 21 10:38:43.410515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 190/399] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:43 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:43.851963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-7e5262f5-7b2d-4393-b315-cf6e8e7ff1f2 req-db401496-8a9a-4dd8-b549-2ac23b617123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66182af-a343-4685-9fa4-66ad970a2dfe", "name": "network-vif-plugged", "status": "completed", "tag": "76dd12a6-8d22-4752-a65b-3c44611d9791"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:43.861219 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7e5262f5-7b2d-4393-b315-cf6e8e7ff1f2 req-db401496-8a9a-4dd8-b549-2ac23b617123 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:43.861661 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7e5262f5-7b2d-4393-b315-cf6e8e7ff1f2 req-db401496-8a9a-4dd8-b549-2ac23b617123 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:43.876603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-7e5262f5-7b2d-4393-b315-cf6e8e7ff1f2 req-db401496-8a9a-4dd8-b549-2ac23b617123 service nova] Creating event network-vif-plugged:76dd12a6-8d22-4752-a65b-3c44611d9791 for instance a66182af-a343-4685-9fa4-66ad970a2dfe on hv-cinder-83697 Jun 21 10:38:43.882095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-7e5262f5-7b2d-4393-b315-cf6e8e7ff1f2 req-db401496-8a9a-4dd8-b549-2ac23b617123 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034902 Jun 21 10:38:43.882714 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 210/400] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:44.172299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:44.173431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:44.183897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:44.184538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:44.185490 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:44.186041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:44.428579 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:44.429332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:44.437609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:44.438094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:44.438877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:44.439305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:44.474875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:44.561819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:44.582886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-54507a38-3015-42f8-a903-19d3dda749ce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1509 microversion: 2.1 time: 0.430462 Jun 21 10:38:44.584060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 191/401] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:44 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:44.653007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:44.663902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-db903a8e-58ef-48c4-8c6a-fc62dfd0e5fb tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.239357 Jun 21 10:38:44.665141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 211/402] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:44 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:45.609176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:45.610045 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:45.617869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:45.618367 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:45.619228 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:45.619662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:45.684066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:45.685626 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:45.699315 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:45.701412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:45.702577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:45.703411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:45.874103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:45.892005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-63e73ab5-6f88-4e8c-9bfa-d39908e437b5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1515 microversion: 2.1 time: 0.285902 Jun 21 10:38:45.894520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 192/403] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:45 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:45.954474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:45.966895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c46e770b-907c-4cb5-826f-b368c41c1e33 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.288880 Jun 21 10:38:45.968353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 212/404] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:45 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:46.681677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4a60fb4-edb9-4409-8fe0-2e0fb19d7913", "device": "/dev/sdb"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:46.684688 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:46.688592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:46.696274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:46.696774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:46.697595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:46.698078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:46.984970 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:46.985796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:46.992087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:46.992543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:46.993325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:46.993757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:47.142715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:47.151631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1d284b8-5ea8-4a6b-afad-80144b1e928f tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.170737 Jun 21 10:38:47.152227 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 213/405] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:46 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:48.176217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:48.176947 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:48.183911 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:48.184352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:48.185112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:48.185535 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:48.336743 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:48.350570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8e7164e3-0739-4bf8-b536-d7fbb09f5986 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.177872 Jun 21 10:38:48.351649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 214/406] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:48 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:49.368127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:49.368986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:49.375321 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:49.375770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:49.376541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:49.377004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:49.519573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:49.527572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bf0cc95f-7fa2-4028-89b0-3c0c5cb33742 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.163412 Jun 21 10:38:49.528151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 215/407] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:49 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:50.546277 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:50.547072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:50.554468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:50.555117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:50.556462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:50.556984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:50.708873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:50.720462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cbb8a992-1319-4501-a2a5-cd296f6f2f76 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.179738 Jun 21 10:38:50.721008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 216/408] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:50 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:38:51.545592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f5d4ab47-2d2c-4428-9e88-099d14ea74b7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "POST /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.870906 Jun 21 10:38:51.547678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 193/409] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:38:46 2022] POST /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198/os-volume_attachments => generated 194 bytes in 4875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:38:51.738330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:51.739806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:51.746929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:51.747583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:51.748704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:51.749212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:51.917249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:51.927138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bd5a10f8-b016-482e-bcad-86198b8bb812 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1314 microversion: 2.1 time: 0.192949 Jun 21 10:38:51.927742 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 217/410] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:51 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:52.950834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:52.952108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:52.960260 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:52.960711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:52.961490 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:52.961921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:53.114251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:53.123510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7f135d4a-bfce-42e1-ba9a-00b06524e220 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1497 microversion: 2.1 time: 0.182296 Jun 21 10:38:53.124087 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 194/411] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:52 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:57.608980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:57.609543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:57.616151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:57.616875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:57.618201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:57.619122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:57.648331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:38:57.748878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-61eebed2-34f0-4d29-9e41-b5e87f9e1ed7 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 204 len: 0 microversion: 2.1 time: 0.143190 Jun 21 10:38:57.749904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 218/412] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:38:57 2022] DELETE /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:38:57.761631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:57.762390 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:57.770547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:57.771822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:57.773006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:57.773602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:57.991340 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:58.001094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a806cffd-5179-488f-af85-347c48bb87f3 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.244260 Jun 21 10:38:58.001687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 195/413] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:57 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:58.528612 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: .version_select at 0x7f8a360949d0>, body: {"keypair": {"name": "tempest-keypair-1936798644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuz8nBzTJy83dIE8iHBqh0hOaRiM6tnpaZfpbc3tPPuh5N7CR2JRWXYjSMC51KHM6/LNcB3Hc5RHF0xnBeGnsI1v2XZTogQXJKFw/ciNI0haC5BjRSnqMgr7tIXMJgPrw=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:38:58.547342 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for project 3ddb0def61dd452db3588952af149fb7. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:38:58.553182 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for user 9bbb5d4487874bdd9f82e28651a418f9 and project 3ddb0def61dd452db3588952af149fb7. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:38:58.570466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [65ac043b-77b4-404b-83f2-22381b21b68a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:38:59.018498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:38:59.019124 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:38:59.028316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:59.028786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:59.029592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:38:59.030019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:38:59.191683 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:38:59.201076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2056dfd5-83c5-4737-8da2-e3b7717a6eae tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.186515 Jun 21 10:38:59.201664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 196/414] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:38:59 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:38:59.580331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [65ac043b-77b4-404b-83f2-22381b21b68a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47682. Jun 21 10:38:59.602452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4780445c-5d89-4950-a26f-0f20933ceb7d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.078816 Jun 21 10:38:59.603320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 219/415] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:38:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:00.222880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:00.223980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:00.233127 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:00.234362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:00.235282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:00.235875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:00.462499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:00.470683 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-80a78574-cbca-493f-9b18-5fadb73b1010 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.254768 Jun 21 10:39:00.471282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 197/416] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:00 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:01.310870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-953043666", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5c66912-fa70-4c1c-9c81-671c5faa702c"}], "security_groups": [{"name": "tempest-securitygroup--1698919928"}], "key_name": "tempest-keypair-1936798644", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:01.433844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] validate_networks() for [('b5c66912-fa70-4c1c-9c81-671c5faa702c', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:39:01.488056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:01.489004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:01.496520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:01.497086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:01.497996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:01.498559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:01.647486 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:01.656457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dd075c43-76fd-4228-83a1-e2b183561c59 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.172312 Jun 21 10:39:01.657049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 198/417] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:01 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:01.887240 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:39:01.888080 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:39:01.889104 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:39:01.889877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:39:01.890697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:39:01.907338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:01.908269 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:01.909629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:01.910403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:01.943045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:39:01.951653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Getting quotas for user 9bbb5d4487874bdd9f82e28651a418f9 and project 3ddb0def61dd452db3588952af149fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:39:01.966175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:39:01.968484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:39:02.015675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:39:02.681681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:02.682582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:02.689360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:02.689805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:02.690627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:02.691053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:02.841618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:02.856400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0975dcda-c2de-494e-9012-486f4e1ca8b0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.178579 Jun 21 10:39:02.861940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 199/418] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:02 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:03.027043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47740. Jun 21 10:39:03.033486 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c5cc0f5f-5416-4ac3-abc2-1d1ae4b44939 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.727165 Jun 21 10:39:03.034699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 220/419] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:39:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:39:03.048295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d4e66964-1977-4abc-aafa-34bfa718a582 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:03.048917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d4e66964-1977-4abc-aafa-34bfa718a582 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:03.109707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d4e66964-1977-4abc-aafa-34bfa718a582 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:03.117589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d4e66964-1977-4abc-aafa-34bfa718a582 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1245 microversion: 2.1 time: 0.073118 Jun 21 10:39:03.118382 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 200/420] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:03 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:03.880251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:03.880871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:03.887572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:03.888017 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:03.888871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:03.889304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:04.065459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:04.078623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d02ad03e-81bd-4060-81f4-6d14e95a846d tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.202157 Jun 21 10:39:04.079769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 221/421] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:03 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:04.137520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:04.138634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:04.150535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:04.151640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:04.153422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:04.154258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:04.230896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:04.237854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:04.248723 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-59e6c2bf-23b5-479f-90d8-ac02f12721cd tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1297 microversion: 2.1 time: 0.117574 Jun 21 10:39:04.249841 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 201/422] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:04 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:05.096366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:05.097086 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:05.103966 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:05.104691 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:05.105836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:05.106302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:05.277301 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:05.283480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:05.284189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:05.285575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-45d4cb4d-c13e-474f-8acc-db049b5dcb44 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1503 microversion: 2.1 time: 0.193020 Jun 21 10:39:05.286196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 222/423] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:05 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:05.293218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:05.293800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:05.294702 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:05.295372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:05.417804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:05.425788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f1eeb91a-b72f-4f94-80b2-923d4a184d80 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1303 microversion: 2.1 time: 0.158663 Jun 21 10:39:05.427185 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 202/424] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:05 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:05.776809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-47773312-b5c1-41ef-ab69-15289d5c4d7d req-7d1e51a0-250e-4f93-8475-694fac7b7548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66182af-a343-4685-9fa4-66ad970a2dfe", "name": "network-vif-deleted", "tag": "76dd12a6-8d22-4752-a65b-3c44611d9791"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:05.785533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-47773312-b5c1-41ef-ab69-15289d5c4d7d req-7d1e51a0-250e-4f93-8475-694fac7b7548 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:05.786205 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-47773312-b5c1-41ef-ab69-15289d5c4d7d req-7d1e51a0-250e-4f93-8475-694fac7b7548 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:05.798349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-47773312-b5c1-41ef-ab69-15289d5c4d7d req-7d1e51a0-250e-4f93-8475-694fac7b7548 service nova] Creating event network-vif-deleted:76dd12a6-8d22-4752-a65b-3c44611d9791 for instance a66182af-a343-4685-9fa4-66ad970a2dfe on hv-cinder-83697 Jun 21 10:39:05.804087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-47773312-b5c1-41ef-ab69-15289d5c4d7d req-7d1e51a0-250e-4f93-8475-694fac7b7548 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Jun 21 10:39:05.804901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 223/425] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:06.303314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:06.304139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:06.312036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:06.312591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:06.313610 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:06.314413 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:06.405183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:06.425507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8f8e65ec-b522-4c93-89e4-e453e4237189 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1299 microversion: 2.1 time: 0.125856 Jun 21 10:39:06.426831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 203/426] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:06 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:06.448430 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:06.449264 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:06.459810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:06.460525 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:06.461765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:06.463615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:06.655256 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:06.663951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-30b383da-aed3-4ccf-b9e1-03625f705a7c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.222601 Jun 21 10:39:06.664577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 224/427] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:06 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:07.449698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:07.450433 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:07.458850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:07.459288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:07.460070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:07.460501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:07.542441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:07.557015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-859750cc-bd2f-4761-91f6-4b865d5e88d0 tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1299 microversion: 2.1 time: 0.113154 Jun 21 10:39:07.563882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 204/428] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:07 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:07.681755 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:07.682393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:07.688484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:07.688938 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:07.689742 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:07.690188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:07.833748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:07.842013 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-492ae8d3-71f5-4f27-bbc5-957b05972631 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.164694 Jun 21 10:39:07.842613 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 225/429] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:07 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:08.581893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:08.582540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:08.589723 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:08.590190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:08.590962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:08.591387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:08.655828 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:08.663578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b29432b0-b9fb-4947-b50a-106c697a8cba tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1299 microversion: 2.1 time: 0.086647 Jun 21 10:39:08.664139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 205/430] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:08 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:08.859671 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:08.860217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:08.866805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:08.867261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:08.868024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:08.868461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:09.010211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:09.018699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6f01e3ec-8ea1-493a-8c7a-b4c07c0f1154 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.163021 Jun 21 10:39:09.019275 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 226/431] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:08 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:09.682470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:09.683083 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:09.689701 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:09.690169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:09.690919 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:09.691335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:09.774690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:09.784360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-92fe3dea-c0b1-4488-be13-a7c59c6b89ad tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1299 microversion: 2.1 time: 0.106166 Jun 21 10:39:09.795524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 206/432] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:09 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:10.037678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:10.040009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:10.048294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.049155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.050160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.050688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.209206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:10.220870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-786a8209-671f-442c-a883-cfec3c671b34 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.187430 Jun 21 10:39:10.221938 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 227/433] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:10 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:10.715015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-60f984f4-a76c-4a72-9d54-fc480cdf4e7c req-10c10ac4-57aa-4ab3-8c39-54b124a39492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:10.725006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-60f984f4-a76c-4a72-9d54-fc480cdf4e7c req-10c10ac4-57aa-4ab3-8c39-54b124a39492 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.725740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-60f984f4-a76c-4a72-9d54-fc480cdf4e7c req-10c10ac4-57aa-4ab3-8c39-54b124a39492 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.739313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-60f984f4-a76c-4a72-9d54-fc480cdf4e7c req-10c10ac4-57aa-4ab3-8c39-54b124a39492 service nova] Creating event network-changed:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:39:10.745252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-60f984f4-a76c-4a72-9d54-fc480cdf4e7c req-10c10ac4-57aa-4ab3-8c39-54b124a39492 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034498 Jun 21 10:39:10.745730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 207/434] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:10.804281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:10.805599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:10.814693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.815165 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.816094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.816540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.886265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:10.887329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:10.887947 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lazy-loading 'fault' on Instance uuid a66182af-a343-4685-9fa4-66ad970a2dfe {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:39:10.899123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:11.161139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e92ccbb22394817bd8a4224cc0d4e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902945afee143b19beb3366841fd72d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:11.168826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fe37404a-1ded-48bc-bbf5-4e89848ffa0c tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 200 len: 1304 microversion: 2.1 time: 0.369166 Jun 21 10:39:11.169531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 228/435] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:10 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 1304 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:11.242528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:11.243462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:11.250482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:11.250934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:11.251703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:11.252132 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:11.394371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:11.406009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7c38c933-a87d-4407-808d-768eca0bcaff tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.170183 Jun 21 10:39:11.406624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 208/436] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:11 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:12.185982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:12.186651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] [instance: a66182af-a343-4685-9fa4-66ad970a2dfe] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:12.188606 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:12.189491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=10 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:12.195888 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:12.196373 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:12.197152 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:12.197582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:12.215221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] HTTP exception thrown: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Request method failure captured: Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe HTTP/1.1 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ9uIGiuB0En1h-lfsO0NmoQaAQSJha54Dfexp9yeC2Hpyw_OWQqKGkHAeqXNZIKWUJFZYwmf4z36kCEaIfwcrilNPr_Cz10uNQR8-UfoYgBgSzsy5BNjS_Ywnf12glQq-eiCH3jIWLK4t9Svdc5X9FzAGRPZku4snKLf3Zoz1Bgcb0 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b902945afee143b19beb3366841fd72d Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesActionsTest-59588677 Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:39:12.217999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b902945afee143b19beb3366841fd72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b902945afee143b19beb3366841fd72d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b902945afee143b19beb3366841fd72d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b902945afee143b19beb3366841fd72d"}]}] Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesActionsTest-59588677 Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b902945afee143b19beb3366841fd72d Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesActionsTest-59588677 Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesActionsTest-59588677-project Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 0e92ccbb22394817bd8a4224cc0d4e13 Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesActionsTest-59588677-project Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. Jun 21 10:39:12.219374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'a66182af-a343-4685-9fa4-66ad970a2dfe'} Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:39:12.220167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. Jun 21 10:39:12.221412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:39:12.223587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] Returning 404 to user: Instance a66182af-a343-4685-9fa4-66ad970a2dfe could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:39:12.223587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f06655a2-872c-4eb0-83b0-1de180d585bf tempest-VolumesActionsTest-59588677 tempest-VolumesActionsTest-59588677-project] 10.222.0.43 "GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe" status: 404 len: 111 microversion: 2.1 time: 0.037567 Jun 21 10:39:12.223587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 229/437] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:12 2022] GET /compute/v2.1/servers/a66182af-a343-4685-9fa4-66ad970a2dfe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:39:12.423697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:12.424974 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:12.433474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:12.434541 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:12.435345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:12.435784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:12.614136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:12.624145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-04761759-a7b0-4585-82b7-befa4ef1a4d7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.204237 Jun 21 10:39:12.624904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 209/438] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:12 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:13.642280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:13.643017 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:13.644973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:13.650232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:13.650750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:13.651762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:13.652877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:13.829715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:13.838632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7acaff6e-3cb4-473a-9f23-73e9ff7cf990 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.201353 Jun 21 10:39:13.839287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 230/439] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:13 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:14.857251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:14.857899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:14.860007 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:14.866746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:14.867210 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:14.867994 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:14.868425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:15.021503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:15.033052 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-772fbea7-de24-4a17-ad1a-a50df201144c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.180104 Jun 21 10:39:15.042626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 210/440] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:14 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:16.052245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:16.052882 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:16.061042 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:16.061614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:16.062877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:16.063523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:16.209113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:16.217834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-42ff82b5-8eb1-4702-addd-11f15a636643 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.169557 Jun 21 10:39:16.218452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 231/441] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:16 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:17.236858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:17.237434 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:17.239920 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=38 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:17.246711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:17.247245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:17.248017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:17.248444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:17.400705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:17.408808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-25bf9333-1ed8-4dd8-9c4a-d3142954e84b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.176604 Jun 21 10:39:17.409395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 211/442] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:17 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:18.425546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:18.426185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:18.432467 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:18.432909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:18.433873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:18.434403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:18.579582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:18.587757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3cabbd42-8f60-4d82-96d9-4d0a5239e504 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.166083 Jun 21 10:39:18.588376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 232/443] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:18 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:19.606572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:19.607238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:19.615196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:19.615707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:19.616583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:19.617078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:19.769189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:19.778662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a63d42eb-b0b1-423d-8c1a-aa1e2210d8a9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.175787 Jun 21 10:39:19.779280 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 212/444] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:19 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:20.798338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:20.798992 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:20.806010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:20.806500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:20.807290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:20.807705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:20.959161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:20.968144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a0823489-4e5a-4161-93f9-35957f851bc1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.173707 Jun 21 10:39:20.968749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 233/445] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:20 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:21.986213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:21.987219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:21.998763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:21.999471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:22.000787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:22.001467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:22.201279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:22.213830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c92aa902-70ca-4ce1-b50c-e225abaa2ac4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.232411 Jun 21 10:39:22.214889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 213/446] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:21 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:23.268279 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:23.269434 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:23.312280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:23.313133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:23.321156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:23.322223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:23.579542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:23.598433 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-530c2009-f839-4532-b5e2-84d0fa6ba93b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.364900 Jun 21 10:39:23.600431 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 234/447] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:23 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:24.627545 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:24.629980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:24.642105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:24.643453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:24.646225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:24.648002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:24.926531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:24.940935 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-eb8c1e76-ed18-4b2b-8fec-b82f60af5806 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.326190 Jun 21 10:39:24.943378 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 214/448] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:24 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:25.744918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-4b00b33c-5731-4101-ac65-9015bf0e9713 req-5f1cb72d-6eec-4676-adcb-72c83ecc1abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "name": "network-vif-plugged", "status": "completed", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:25.762329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4b00b33c-5731-4101-ac65-9015bf0e9713 req-5f1cb72d-6eec-4676-adcb-72c83ecc1abd service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:25.763641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4b00b33c-5731-4101-ac65-9015bf0e9713 req-5f1cb72d-6eec-4676-adcb-72c83ecc1abd service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:25.796662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-4b00b33c-5731-4101-ac65-9015bf0e9713 req-5f1cb72d-6eec-4676-adcb-72c83ecc1abd service nova] Creating event network-vif-plugged:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:39:25.809725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-4b00b33c-5731-4101-ac65-9015bf0e9713 req-5f1cb72d-6eec-4676-adcb-72c83ecc1abd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073864 Jun 21 10:39:25.811319 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 235/449] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:39:25.975753 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:25.988235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:26.058099 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:26.058934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:26.060352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:26.061135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:26.757609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:26.773371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b923909b-13a2-48b8-a195-abafaf720732 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.808926 Jun 21 10:39:26.781656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 215/450] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:25 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:27.800164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:27.801117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:27.815619 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:27.816554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:27.818018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:27.819126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:28.061456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:28.070787 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6dbfefc1-2ca7-4f91-9242-3a3dc1d4779c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.274996 Jun 21 10:39:28.072053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 236/451] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:27 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:29.098104 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:29.099040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:29.114686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:29.115483 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:29.116535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:29.117655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:29.367189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:29.389769 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2ca99681-e185-447c-8dab-91d94592655c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.294947 Jun 21 10:39:29.394298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 216/452] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:29 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:30.414343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:30.415668 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:30.422946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:30.423451 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:30.425975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:30.425975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:30.588329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:30.598591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-74076ff4-4e3f-44fa-ba7a-cccebe08e946 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.188575 Jun 21 10:39:30.599195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 237/453] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:30 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:31.615155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:31.615768 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:31.629570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:31.634844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:31.636043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:31.637568 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:32.068976 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:32.119942 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3a261d91-7a8f-46bc-a7b9-d099c0e68bc4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.507906 Jun 21 10:39:32.126500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 217/454] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:31 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:33.156539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:33.162912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:33.192793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:33.192793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:33.192793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:33.195442 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:33.615583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:33.635710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-12776275-edbf-4beb-8774-912d356fd150 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1371 microversion: 2.1 time: 0.486042 Jun 21 10:39:33.637267 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 238/455] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:33 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:34.661452 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:34.667089 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:34.673089 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:34.673803 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:34.675371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:34.677097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:34.998557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:35.038370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4814bb69-47bf-4f82-a953-000cfb78a1a7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1565 microversion: 2.1 time: 0.380912 Jun 21 10:39:35.040319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 218/456] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:34 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1565 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:35.074710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:35.080139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:35.101171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:35.102984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:35.104781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:35.106245 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:35.327031 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-02ed6f0b-605a-4fc1-9c80-dee291df1d9f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.260877 Jun 21 10:39:35.327973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 239/457] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:39:35 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:38.289691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-47c8a5cb-ff0d-4869-9897-4d9dbc922c34 req-ef4dec91-fbb4-4b86-8460-db50c7fbd77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:38.303212 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-47c8a5cb-ff0d-4869-9897-4d9dbc922c34 req-ef4dec91-fbb4-4b86-8460-db50c7fbd77d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:38.303644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-47c8a5cb-ff0d-4869-9897-4d9dbc922c34 req-ef4dec91-fbb4-4b86-8460-db50c7fbd77d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:38.359624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=99 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:38.368148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-47c8a5cb-ff0d-4869-9897-4d9dbc922c34 req-ef4dec91-fbb4-4b86-8460-db50c7fbd77d service nova] Creating event network-changed:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:39:38.393752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-47c8a5cb-ff0d-4869-9897-4d9dbc922c34 req-ef4dec91-fbb4-4b86-8460-db50c7fbd77d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101559 Jun 21 10:39:38.395844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 219/458] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:44.555441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-47cb515c-04a8-4b26-842e-d525757f57b7 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Action: 'create', calling method: .version_select at 0x7f8a361329d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-238040267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyOXmHuDuRD5xPTvW/qr+DrpqUUZos0Lgig+0LMsg0fmwqYZ+XBemg6ugFSkZGP4O8wxHBcRBYG+AUCgmPGDg5IwyptRpwSyoEEbzynN9wKfRTxkWpffzaYaChpWQvxPA=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:44.570216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=20 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:44.587605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-47cb515c-04a8-4b26-842e-d525757f57b7 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Getting quotas for project f07dc511991f4d9f87aa5256f76e402c. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:39:44.593875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-47cb515c-04a8-4b26-842e-d525757f57b7 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Getting quotas for user c0579a5ba91a4aa89b676598b6d9dfeb and project f07dc511991f4d9f87aa5256f76e402c. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:39:44.632933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-47cb515c-04a8-4b26-842e-d525757f57b7 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.526577 Jun 21 10:39:44.633548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 240/459] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:39:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:47.178767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-184433235", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:47.290141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] validate_networks() for None {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:39:48.001695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:39:48.002757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:39:48.004049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:39:48.004776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:39:48.005349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:39:48.017291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=20 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:48.056350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:48.057275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:48.059321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:48.061205 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:48.100309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Getting quotas for project be13aa2616dd46178014348c9778fd01. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:39:48.121627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Getting quotas for user 510c86375cc54cc1b84b2dc05b11fbcf and project be13aa2616dd46178014348c9778fd01. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:39:48.159895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:39:48.164404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:39:48.298340 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b17b4ec3-f144-4ab6-8615-107481c51fd4 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120947 Jun 21 10:39:48.305771 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 220/460] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:39:48.317325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f76a843b-1a00-4f7d-ad08-b8f57f6f3f60 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:48.317928 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f76a843b-1a00-4f7d-ad08-b8f57f6f3f60 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:48.320120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=58 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:48.408384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f76a843b-1a00-4f7d-ad08-b8f57f6f3f60 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:48.430797 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f76a843b-1a00-4f7d-ad08-b8f57f6f3f60 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1214 microversion: 2.1 time: 0.120671 Jun 21 10:39:48.431465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 241/461] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:48 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:49.452906 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:49.454990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:49.482125 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:49.484183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:49.486359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:49.487573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:49.627024 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:49.648766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-260a06e7-e2c6-4da9-848a-6e84f2a819dc tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1266 microversion: 2.1 time: 0.202874 Jun 21 10:39:49.651098 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 221/462] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:49 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:49.949138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:49.951243 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:49.989888 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:49.998074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:49.999534 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:49.999995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:50.271410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lazy-loading 'services' on Instance uuid ce0f562e-5888-4fcd-ab20-f4bda698a198 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:39:50.468175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5cdaf064-b73b-4046-8e41-e4358947be4f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198/os-volume_attachments/d4a60fb4-edb9-4409-8fe0-2e0fb19d7913" status: 202 len: 0 microversion: 2.1 time: 0.525599 Jun 21 10:39:50.470462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 242/463] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:39:49 2022] DELETE /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198/os-volume_attachments/d4a60fb4-edb9-4409-8fe0-2e0fb19d7913 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:39:50.675359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:50.678913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:50.690590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:50.691938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:50.693765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:50.695194 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:50.942952 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:50.968353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-26a4e7a2-aa16-4cc4-a98d-0fd3b41e51a9 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1272 microversion: 2.1 time: 0.301527 Jun 21 10:39:50.986673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 222/464] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:50 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:52.005470 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:52.013679 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:52.081634 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.083137 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:52.085856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.090846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:52.378731 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:52.388727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-88f417bf-e5b3-4226-beb4-86e27ef06877 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.400561 Jun 21 10:39:52.399531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 243/465] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:51 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:52.735500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:52.736158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:52.743732 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.744884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:52.746339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.747212 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:52.798904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:39:52.929595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2e7a9950-c09a-48c5-8c93-d9cf1f000012 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 204 len: 0 microversion: 2.1 time: 0.197760 Jun 21 10:39:52.930838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 223/466] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:39:52 2022] DELETE /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:39:52.942385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:52.943005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:52.954232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.955400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:52.956789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:52.957550 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:53.013051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-b5183d47-a055-47a7-a88f-602d72e45e99 req-fb1ebe12-7890-408a-82bc-1e8acfab1618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd8db8a-9b77-4986-b3fb-c5878f9a831b", "tag": "8e7186b6-d7be-4854-9217-bfb83bc09879"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:53.027912 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-b5183d47-a055-47a7-a88f-602d72e45e99 req-fb1ebe12-7890-408a-82bc-1e8acfab1618 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:53.028366 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-b5183d47-a055-47a7-a88f-602d72e45e99 req-fb1ebe12-7890-408a-82bc-1e8acfab1618 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:53.041878 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-b5183d47-a055-47a7-a88f-602d72e45e99 req-fb1ebe12-7890-408a-82bc-1e8acfab1618 service nova] Creating event network-changed:8e7186b6-d7be-4854-9217-bfb83bc09879 for instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b on hv-cinder-83697 Jun 21 10:39:53.047688 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-b5183d47-a055-47a7-a88f-602d72e45e99 req-fb1ebe12-7890-408a-82bc-1e8acfab1618 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041333 Jun 21 10:39:53.048295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 224/467] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:53.139542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:53.148086 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3beeb810-23b9-4274-85b8-d3e67973b1bd tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1513 microversion: 2.1 time: 0.209840 Jun 21 10:39:53.148677 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 244/468] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:52 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:53.408056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:53.408939 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:53.417483 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:53.418296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:53.418890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:53.419391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:53.574149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:53.584120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ab334c17-4ae5-46e1-8806-447a5a186258 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.180110 Jun 21 10:39:53.584120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 225/469] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:53 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:54.167157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:54.168144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:54.178295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:54.178892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:54.179640 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:54.180136 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:54.365807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:54.381457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2d5768ee-c90b-4a07-b0cc-c40d4deda74f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1513 microversion: 2.1 time: 0.218814 Jun 21 10:39:54.382702 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 245/470] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:54 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:54.604567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:54.605691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:54.612776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:54.613226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:54.613989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:54.614701 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:54.908335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:54.917563 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a8887668-a7e2-4d74-bdce-53767d6f857d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.316778 Jun 21 10:39:54.918476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 226/471] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:54 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:55.401783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:55.402710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:55.410927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:55.411784 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:55.413079 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:55.414005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:55.585781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:55.594623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a0cc7531-880f-4946-91c7-8d745397b9f6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1513 microversion: 2.1 time: 0.197494 Jun 21 10:39:55.595221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 246/472] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:55 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:55.936598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:55.937492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:55.944748 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:55.945057 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:55.945830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:55.946295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:56.616849 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:56.618739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:56.629264 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:56.640261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:56.641841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:56.645671 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:56.655510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:56.693848 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-43cbc444-d3b4-4e77-9708-5a51da076987 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.761585 Jun 21 10:39:56.694374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 227/473] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:55 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:56.888578 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:56.897864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-879fcb0e-da5d-4f64-a7de-253606ca8c4a tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1513 microversion: 2.1 time: 0.288173 Jun 21 10:39:56.898516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 247/474] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:56 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:56.977341 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-948601d2-5ba4-4bb3-8eeb-52f6bcbdbc3f req-63e9ea48-b486-41f6-8385-499272446344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0f562e-5888-4fcd-ab20-f4bda698a198", "name": "network-vif-deleted", "tag": "832d4cbc-3c2d-470f-b9b4-cbecad9a519e"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:39:56.989132 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-948601d2-5ba4-4bb3-8eeb-52f6bcbdbc3f req-63e9ea48-b486-41f6-8385-499272446344 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:56.989740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-948601d2-5ba4-4bb3-8eeb-52f6bcbdbc3f req-63e9ea48-b486-41f6-8385-499272446344 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:57.004913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-948601d2-5ba4-4bb3-8eeb-52f6bcbdbc3f req-63e9ea48-b486-41f6-8385-499272446344 service nova] Creating event network-vif-deleted:832d4cbc-3c2d-470f-b9b4-cbecad9a519e for instance ce0f562e-5888-4fcd-ab20-f4bda698a198 on hv-cinder-83697 Jun 21 10:39:57.011747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-948601d2-5ba4-4bb3-8eeb-52f6bcbdbc3f req-63e9ea48-b486-41f6-8385-499272446344 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038017 Jun 21 10:39:57.012771 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 228/475] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:39:57.712226 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:57.713427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:57.722599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:57.723060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:57.724427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:57.725128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:57.918715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:57.919767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:57.927174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:57.927623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:57.928403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:57.929087 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:57.932311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:57.940881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8ab4f29f-1b9c-49e7-ae52-90aa382e63bb tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.233379 Jun 21 10:39:57.941946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 248/476] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:57 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:39:58.019139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:58.020675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-53d65e64-c8ed-4461-94a0-5f70ead80026 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1471 microversion: 2.1 time: 0.107750 Jun 21 10:39:58.021287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 229/477] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:57 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:58.959481 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:58.960131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:58.962447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:58.968935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:58.969435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:58.970328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:58.970810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:59.040108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:39:59.040754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:39:59.043023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:59.044180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:59.049835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:59.050313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:59.051514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:39:59.052038 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:39:59.130562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:59.138309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5dc23b3c-3c36-4c4d-a284-4c590fe26812 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1471 microversion: 2.1 time: 0.102216 Jun 21 10:39:59.138903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 230/478] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:59 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:39:59.154519 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:39:59.162317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fa6d24e1-cb62-4dcd-bb21-f71e74fb9530 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.206838 Jun 21 10:39:59.162891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 249/479] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:39:58 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:00.155618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:00.156271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:00.163604 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:00.164043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:00.164809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:00.165261 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:00.179631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:00.180237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:00.187880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:00.188329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:00.189110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:00.189546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:00.247359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:00.259408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1a14e6d2-9a73-4fca-b9c1-893225f720f7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 200 len: 1471 microversion: 2.1 time: 0.107869 Jun 21 10:40:00.259977 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 231/480] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:00 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:00.371490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:00.379890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-515969a4-dedb-4536-ad20-89b85bc83e0b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.203954 Jun 21 10:40:00.382243 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 250/481] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:00 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:01.277751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:01.278704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: ce0f562e-5888-4fcd-ab20-f4bda698a198] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:01.285877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:01.286327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:01.287365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:01.287815 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:01.306666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] HTTP exception thrown: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Request method failure captured: Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 HTTP/1.1 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ9qMEixFHDEuBBWYBj24CFItA-aE-ESKltlK71Xyw6nL8wHhpN0Yrqc0ZqnO2_dO5GxDe54GQ6xWa1Ydf_ZLu2E4Sx_VNk-GOwz7v41AUv1WFN2AxfBqDff0SHc9FElTCUy5LHaBvn0vOUhbU1eVbTUkBvQKRcNv0P_XnNXcVj8Lz0 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 849b037f3f424220b53da5537c2cebf3 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:40:01.308694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/849b037f3f424220b53da5537c2cebf3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_849b037f3f424220b53da5537c2cebf3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/849b037f3f424220b53da5537c2cebf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/849b037f3f424220b53da5537c2cebf3"}]}] Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 849b037f3f424220b53da5537c2cebf3 Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesSnapshotTestJSON-797128761-project Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 3eb8cf247b6b4d6981191b804790f5f0 Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesSnapshotTestJSON-797128761-project Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. Jun 21 10:40:01.310873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'ce0f562e-5888-4fcd-ab20-f4bda698a198'} Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:40:01.312337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. Jun 21 10:40:01.315827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:01.319882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Returning 404 to user: Instance ce0f562e-5888-4fcd-ab20-f4bda698a198 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:40:01.319882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3b83fb25-7cf9-496f-84dd-0f10ede91726 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198" status: 404 len: 111 microversion: 2.1 time: 0.036404 Jun 21 10:40:01.319882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 232/482] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:01 2022] GET /compute/v2.1/servers/ce0f562e-5888-4fcd-ab20-f4bda698a198 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:40:01.399846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:01.400694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:01.407480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:01.407965 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:01.408781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:01.409219 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:01.634492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:01.643452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a98ed9a-121e-4355-b412-b702da0c844f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.247887 Jun 21 10:40:01.644046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 251/483] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:01 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:02.661145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:02.661858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:02.669016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:02.669427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:02.670532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:02.670959 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:02.823802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:02.832406 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-29174bed-d551-4711-89e7-9e6aa189a770 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.175086 Jun 21 10:40:02.833233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 233/484] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:02 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:03.851307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:03.851944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:03.858769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:03.859224 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:03.860311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:03.860966 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:04.001289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:04.012544 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f45c324d-8a42-4b11-b053-481b95bd96d5 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.165426 Jun 21 10:40:04.013185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 252/485] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:03 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:05.031678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:05.032388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:05.039434 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:05.039870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:05.040661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:05.041086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:05.192498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:05.201112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2198d5e9-1a83-4743-a01b-67fdb2700a9c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.173851 Jun 21 10:40:05.202141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 234/486] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:05 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:06.219830 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:06.220507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:06.227953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:06.228622 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:06.229511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:06.229973 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:06.370984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:06.380161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-149be26e-0789-4892-9dd3-c53c36beaf0e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.164755 Jun 21 10:40:06.380810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 253/487] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:06 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:07.402650 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:07.403287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:07.411030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:07.411468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:07.412245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:07.412667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:07.565320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:07.573601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6802d32e-7ab5-4693-852e-9534fb2e065d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.174680 Jun 21 10:40:07.574123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 235/488] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:07 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:08.592004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:08.592638 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:08.599333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:08.599780 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:08.600552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:08.601068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:08.737637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:08.745445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2c87bf32-4c36-48b3-8e05-2be35577c1ef tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.157442 Jun 21 10:40:08.746164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 254/489] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:08 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:09.637324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-d34dbaf1-2a74-46d4-ba50-ba18fdd1e98a req-d28810f8-dfe6-4c5d-afd8-5cc6bad1717a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd8db8a-9b77-4986-b3fb-c5878f9a831b", "name": "network-vif-plugged", "status": "completed", "tag": "8e7186b6-d7be-4854-9217-bfb83bc09879"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:09.646522 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-d34dbaf1-2a74-46d4-ba50-ba18fdd1e98a req-d28810f8-dfe6-4c5d-afd8-5cc6bad1717a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:09.646951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-d34dbaf1-2a74-46d4-ba50-ba18fdd1e98a req-d28810f8-dfe6-4c5d-afd8-5cc6bad1717a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:09.649576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:09.661000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-d34dbaf1-2a74-46d4-ba50-ba18fdd1e98a req-d28810f8-dfe6-4c5d-afd8-5cc6bad1717a service nova] Creating event network-vif-plugged:8e7186b6-d7be-4854-9217-bfb83bc09879 for instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b on hv-cinder-83697 Jun 21 10:40:09.666180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-d34dbaf1-2a74-46d4-ba50-ba18fdd1e98a req-d28810f8-dfe6-4c5d-afd8-5cc6bad1717a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 Jun 21 10:40:09.666862 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 236/490] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:09.762958 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:09.763576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:09.769387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:09.769831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:09.770616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:09.771045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:09.921353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:09.931108 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-19a6043f-0d4f-4539-8b0d-de23b5c7c83e tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.172316 Jun 21 10:40:09.932130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 255/491] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:09 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:10.949976 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:10.950721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:10.961392 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:10.961763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:10.962795 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:10.963426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:11.117144 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:11.125474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-780f44c7-8e4f-4fe7-aaad-57d7efe87b3b tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.180304 Jun 21 10:40:11.126078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 237/492] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:10 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:12.144601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:12.145266 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:12.151790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:12.152507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:12.153326 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:12.153780 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:12.324170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:12.336941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-20de9953-e6d0-468b-85c0-f324c29ad29c tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1314 microversion: 2.1 time: 0.195812 Jun 21 10:40:12.337694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 256/493] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:12 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:13.362288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:13.362902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:13.369624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.370100 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.370866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.371297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.519787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:13.528310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bcafa398-5c0d-49b4-bff4-e15cfb9a47d1 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1463 microversion: 2.1 time: 0.169896 Jun 21 10:40:13.528944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 238/494] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:13 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:13.587631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:13.588238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:13.595160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.595609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.596417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.596855 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.627162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:40:13.630398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:13.718924 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50f91fce-cc91-47e7-a962-8f5a730bd829 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 204 len: 0 microversion: 2.1 time: 0.135170 Jun 21 10:40:13.720036 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 257/495] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:40:13 2022] DELETE /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:40:13.730042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:13.730666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:13.737804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.738309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.739114 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:13.739553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:13.897468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:13.906302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-eb16b9da-da9c-4aa8-ac71-09801e76a211 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.180828 Jun 21 10:40:13.907424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 239/496] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:13 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:14.306476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:14.307239 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:14.315641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:14.316232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:14.317299 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:14.317886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:14.343786 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ab1fb7fc-c38c-425d-9f5b-0851429f48c1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/ips" status: 200 len: 146 microversion: 2.1 time: 0.044151 Jun 21 10:40:14.344350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 258/497] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:40:14 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:14.928817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:14.929840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:14.942709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:14.943191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:14.943967 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:14.944395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:15.093064 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:15.101528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d542e96a-c5f7-4a2a-98ec-b586208600bd tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.180142 Jun 21 10:40:15.102155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 240/498] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:14 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:16.122036 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:16.122663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:16.125589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:16.131553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:16.131978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:16.132748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:16.133178 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:16.276918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:16.285117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9c480e0d-3152-49e3-9bde-69426fa2732f tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.169319 Jun 21 10:40:16.285690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 259/499] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:16 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:17.302815 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:17.303428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:17.310179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:17.310631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:17.311386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:17.311817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:17.459556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:17.468976 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-531dc363-8e01-4369-8f28-f8598b45b78d tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.170280 Jun 21 10:40:17.469986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 241/500] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:17 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:18.487410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:18.488071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:18.494576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:18.495028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:18.495938 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:18.496230 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:18.634781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:18.643442 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8febb060-0241-4a53-81c9-640c9bd34722 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.160218 Jun 21 10:40:18.644093 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 260/501] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:18 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:19.661270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:19.661892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-257659855", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "networks": [{"uuid": "fb205f36-3fd5-4f5a-96e2-bc5dda48ab75"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:19.662536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:19.664446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:19.670779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:19.671219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:19.671976 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:19.672393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:19.729403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] validate_networks() for [('fb205f36-3fd5-4f5a-96e2-bc5dda48ab75', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:40:19.836717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:19.845262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-298fdf34-b37f-4845-a227-d2f069bd0d79 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.188084 Jun 21 10:40:19.846156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 242/502] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:19 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:20.351543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:40:20.351912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:40:20.352402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:40:20.352956 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:40:20.353470 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:40:20.365416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.365853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:20.366672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.367100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:20.385175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Getting quotas for project 849b037f3f424220b53da5537c2cebf3. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:40:20.389564 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Getting quotas for user 3eb8cf247b6b4d6981191b804790f5f0 and project 849b037f3f424220b53da5537c2cebf3. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:40:20.400698 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:40:20.403015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:40:20.457615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1fef88d7-e36e-4914-b21a-dd2dc7260fc4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799530 Jun 21 10:40:20.458246 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 261/503] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:40:20.469142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f0bafaf6-7e78-4fb4-b6c0-e8fcf6c69d93 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:20.469893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f0bafaf6-7e78-4fb4-b6c0-e8fcf6c69d93 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:20.524823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0bafaf6-7e78-4fb4-b6c0-e8fcf6c69d93 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:20.533534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f0bafaf6-7e78-4fb4-b6c0-e8fcf6c69d93 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1218 microversion: 2.1 time: 0.067883 Jun 21 10:40:20.534831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 243/504] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:20 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:20.725011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48eb9054-79ac-4c81-9cea-381e363269c3"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:20.726207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:20.732589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.733051 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:20.733804 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.734274 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:20.865380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:20.866099 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:20.876053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.877337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:20.878302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:20.878747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:21.061233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:21.078584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dba35e25-778a-43bc-a635-dcd5c2b281ca tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.212071 Jun 21 10:40:21.079861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 244/505] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:20 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:21.124218 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c858e2f3-f43d-457e-92a2-6d2fc5b1247b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403429 Jun 21 10:40:21.124874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 262/506] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:40:20 2022] POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:21.550375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:21.550990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:21.557495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:21.557933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:21.558725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:21.559151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:21.634191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:21.645762 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7a7528f7-2bd1-4b4a-897f-7ee912c32590 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1270 microversion: 2.1 time: 0.099353 Jun 21 10:40:21.646462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 245/507] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:21 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:22.098385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:22.099028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:22.105963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:22.106440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:22.107344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:22.107773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:22.283876 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:22.300366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-04123b2f-741d-4d7b-9e61-112e56fdae94 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1469 microversion: 2.1 time: 0.206437 Jun 21 10:40:22.301613 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 263/508] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:22 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:22.664687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:22.665387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:22.672354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:22.672790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:22.674497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:22.674997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:22.810304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:22.826768 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-521edc37-72eb-4e21-9f0f-ff0b121af3d0 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1276 microversion: 2.1 time: 0.165260 Jun 21 10:40:22.827752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 246/509] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:22 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:23.296901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-820b5623-09ad-4166-ab88-038bf2e1313f req-4e404837-5a67-4dfb-8dcb-a3954a53ed92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd8db8a-9b77-4986-b3fb-c5878f9a831b", "name": "network-vif-deleted", "tag": "8e7186b6-d7be-4854-9217-bfb83bc09879"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:23.324318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:23.324938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:23.340421 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:23.341363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:23.342376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:23.342802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:23.343297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-820b5623-09ad-4166-ab88-038bf2e1313f req-4e404837-5a67-4dfb-8dcb-a3954a53ed92 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:23.343835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-820b5623-09ad-4166-ab88-038bf2e1313f req-4e404837-5a67-4dfb-8dcb-a3954a53ed92 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:23.367400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-820b5623-09ad-4166-ab88-038bf2e1313f req-4e404837-5a67-4dfb-8dcb-a3954a53ed92 service nova] Creating event network-vif-deleted:8e7186b6-d7be-4854-9217-bfb83bc09879 for instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b on hv-cinder-83697 Jun 21 10:40:23.373622 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-820b5623-09ad-4166-ab88-038bf2e1313f req-4e404837-5a67-4dfb-8dcb-a3954a53ed92 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085390 Jun 21 10:40:23.375251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 264/510] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:23.435827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510c86375cc54cc1b84b2dc05b11fbcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be13aa2616dd46178014348c9778fd01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:23.444590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b4d51b31-e5bc-46e0-bea8-aecfbae85463 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 200 len: 1299 microversion: 2.1 time: 0.129379 Jun 21 10:40:23.446130 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 247/511] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:23 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:23.847379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:23.848234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:23.863364 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:23.863717 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:23.865871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:23.866870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:24.078225 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:24.086920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f83a7d88-90d2-4c1d-b4af-c2a56a03fbf6 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.244073 Jun 21 10:40:24.087685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 265/512] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:23 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:24.470235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:24.471190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] [instance: 3bd8db8a-9b77-4986-b3fb-c5878f9a831b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:24.479019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:24.479570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:24.480919 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:24.481738 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:24.499811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] HTTP exception thrown: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Request method failure captured: Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b HTTP/1.1 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ_vmdt-BmCtY2oqDlrLdTJOZTttBzRitsQZcs0S0QKexlzpp-Is4aODTA4sZagLs7pxQ331KnSCfY_Ho23IN_QcbqcE3TjQl95WqQFwYYcdNI89mB-CmahZkwz0FbLHoqJlYfahIbn4a0ia6bNaC0jyiu6zo5lG4-yRAIVKg7NUEnk Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: be13aa2616dd46178014348c9778fd01 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesNegativeTest-959683380 Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:40:24.502437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be13aa2616dd46178014348c9778fd01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_be13aa2616dd46178014348c9778fd01", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/be13aa2616dd46178014348c9778fd01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/be13aa2616dd46178014348c9778fd01"}]}] Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesNegativeTest-959683380 Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: be13aa2616dd46178014348c9778fd01 Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesNegativeTest-959683380 Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesNegativeTest-959683380-project Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 510c86375cc54cc1b84b2dc05b11fbcf Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesNegativeTest-959683380-project Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. Jun 21 10:40:24.505036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '3bd8db8a-9b77-4986-b3fb-c5878f9a831b'} Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:40:24.506619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. Jun 21 10:40:24.508926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:40:24.511266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] Returning 404 to user: Instance 3bd8db8a-9b77-4986-b3fb-c5878f9a831b could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:40:24.511266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1172cde4-227e-4c45-848d-97a6aa816f90 tempest-VolumesNegativeTest-959683380 tempest-VolumesNegativeTest-959683380-project] 10.222.0.43 "GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b" status: 404 len: 111 microversion: 2.1 time: 0.037877 Jun 21 10:40:24.511266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 248/513] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:24 2022] GET /compute/v2.1/servers/3bd8db8a-9b77-4986-b3fb-c5878f9a831b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:40:25.108916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:25.109482 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:25.118329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:25.118692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:25.119872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:25.120008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:25.297794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:25.306443 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a902a33-7a04-4267-b52c-78f8fbf3094f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.201355 Jun 21 10:40:25.307176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 266/514] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:25 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:25.397928 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-b5025ca3-0437-4121-8f85-e087530d62f5 req-95fb2b0f-e607-4e8a-9dc6-be45e25f2d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ffa1c54-3631-44e0-bbd6-0d4793a066e2", "tag": "f34d100e-af0e-43b7-989b-ac0978af2874"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:25.407112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-b5025ca3-0437-4121-8f85-e087530d62f5 req-95fb2b0f-e607-4e8a-9dc6-be45e25f2d37 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:25.408246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-b5025ca3-0437-4121-8f85-e087530d62f5 req-95fb2b0f-e607-4e8a-9dc6-be45e25f2d37 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:25.421223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-b5025ca3-0437-4121-8f85-e087530d62f5 req-95fb2b0f-e607-4e8a-9dc6-be45e25f2d37 service nova] Creating event network-changed:f34d100e-af0e-43b7-989b-ac0978af2874 for instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 on hv-cinder-83697 Jun 21 10:40:25.427380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-b5025ca3-0437-4121-8f85-e087530d62f5 req-95fb2b0f-e607-4e8a-9dc6-be45e25f2d37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 Jun 21 10:40:25.427996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 249/515] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:26.213666 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1884434910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-238040267", "security_groups": [{"name": "tempest-secgroup-smoke-127107997"}], "networks": [{"uuid": "4928c6e9-8fe8-4d6b-957d-696f54f05e49"}], "block_device_mapping_v2": [{"uuid": "16cc2a96-6a02-4183-94da-17c25aebeead", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:26.328898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:26.329901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:26.338186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:26.338646 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:26.339452 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:26.339945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:26.390935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] validate_networks() for [('4928c6e9-8fe8-4d6b-957d-696f54f05e49', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:40:26.548350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:26.572288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2341108e-fe74-4bdd-bf04-22d636321744 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.249983 Jun 21 10:40:26.574179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 250/516] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:26 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:26.920497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:40:26.921045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:40:26.921761 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:40:26.922457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:40:26.923148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:40:26.935668 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:26.936713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:26.938743 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:26.939128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:26.969723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Getting quotas for project f07dc511991f4d9f87aa5256f76e402c. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:40:26.976054 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Getting quotas for user c0579a5ba91a4aa89b676598b6d9dfeb and project f07dc511991f4d9f87aa5256f76e402c. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:40:27.048070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:40:27.050299 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16cc2a96-6a02-4183-94da-17c25aebeead',volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:40:27.211239 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b357b2f6-60aa-43da-907b-0a0e95bd73ab tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.001363 Jun 21 10:40:27.212220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 267/517] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:40:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:40:27.241143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3920b97b-9c68-4e01-832e-2d968f70cc72 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:27.242162 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3920b97b-9c68-4e01-832e-2d968f70cc72 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:27.356171 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3920b97b-9c68-4e01-832e-2d968f70cc72 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:27.379137 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3920b97b-9c68-4e01-832e-2d968f70cc72 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1088 microversion: 2.1 time: 0.159227 Jun 21 10:40:27.380472 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 251/518] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:27 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1088 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:27.595428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:27.596295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:27.604667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:27.607778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:27.609409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:27.610247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:27.898979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:27.909441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4e8b4af6-e9dc-4a9a-ae3d-9db758768b6d tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.320953 Jun 21 10:40:27.919413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 268/519] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:27 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:28.402077 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:28.402713 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:28.410642 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:28.411400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:28.412512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:28.413159 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:28.508625 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:28.517088 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b3236b84-a55c-421f-80bf-f229888d2313 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1138 microversion: 2.1 time: 0.120812 Jun 21 10:40:28.517671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 252/520] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:28 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1138 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:28.926675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:28.927463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:28.935920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:28.936372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:28.937175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:28.937705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:29.125693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:29.134031 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-905cda4e-d695-416d-af45-6e232de0a6ef tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.211498 Jun 21 10:40:29.134651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 269/521] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:28 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:29.539254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:29.541479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:29.555801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:29.556935 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:29.558695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:29.560282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:29.668551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:29.678478 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c7429b7a-93fa-428b-a98b-17353adabf6b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1138 microversion: 2.1 time: 0.146216 Jun 21 10:40:29.679057 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 253/522] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:29 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1138 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:30.155635 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:30.156701 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:30.168507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:30.169324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:30.170836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:30.171605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:30.629390 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:30.648503 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc06476d-d67f-4740-b26f-b27f2366a0f3 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.498645 Jun 21 10:40:30.649680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 270/523] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:30 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:30.709783 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:30.711086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:30.724424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:30.725286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:30.726924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:30.727966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:30.824122 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:30.832971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0298687c-dcea-4b8c-b036-a6205f894098 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1186 microversion: 2.1 time: 0.133198 Jun 21 10:40:30.833598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 254/524] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:30 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1186 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:31.154263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-785992f2-9185-410a-8894-bab13512826d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:31.164640 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-785992f2-9185-410a-8894-bab13512826d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.165346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-785992f2-9185-410a-8894-bab13512826d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.250678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-785992f2-9185-410a-8894-bab13512826d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Going to try to stop instance {{(pid=124179) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 10:40:31.321671 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-785992f2-9185-410a-8894-bab13512826d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.173419 Jun 21 10:40:31.322350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 271/525] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:40:31 2022] POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:40:31.336763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:31.337400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:31.351731 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.351970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.352743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.353370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.548254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:31.558670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5ef97aaf-5eb1-4770-84c2-06caf25ac824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.231435 Jun 21 10:40:31.559315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 255/526] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:31 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:31.673536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:31.674294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:31.681978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.682469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.683281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.683723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.853174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:31.854645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:31.865087 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.865865 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.866969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:31.867696 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:31.868641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:31.876374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:31.887587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-93b99ebd-f34b-4885-8e8d-75fb1094cf85 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.218075 Jun 21 10:40:31.889045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 272/527] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:31 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:32.000052 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:32.004733 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:32.017635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0986c47b-23c8-4710-91ea-dbdebf25066c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1204 microversion: 2.1 time: 0.169029 Jun 21 10:40:32.018755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 256/528] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:31 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1204 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:32.134413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-4a8f544b-2dfb-460c-bac6-e00ac40eece1 req-496ff48b-da17-430a-aef3-4dc198b6c716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ffa1c54-3631-44e0-bbd6-0d4793a066e2", "name": "network-vif-plugged", "status": "completed", "tag": "f34d100e-af0e-43b7-989b-ac0978af2874"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:32.149188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4a8f544b-2dfb-460c-bac6-e00ac40eece1 req-496ff48b-da17-430a-aef3-4dc198b6c716 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:32.150287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-4a8f544b-2dfb-460c-bac6-e00ac40eece1 req-496ff48b-da17-430a-aef3-4dc198b6c716 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:32.169862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-4a8f544b-2dfb-460c-bac6-e00ac40eece1 req-496ff48b-da17-430a-aef3-4dc198b6c716 service nova] Creating event network-vif-plugged:f34d100e-af0e-43b7-989b-ac0978af2874 for instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 on hv-cinder-83697 Jun 21 10:40:32.177410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-4a8f544b-2dfb-460c-bac6-e00ac40eece1 req-496ff48b-da17-430a-aef3-4dc198b6c716 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050754 Jun 21 10:40:32.178437 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 273/529] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:32.583527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:32.585278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:32.598613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:32.599416 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:32.600844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:32.601619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:32.862850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:32.879203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e62adb1c-e50b-4223-b41d-74bcc3d22824 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.303218 Jun 21 10:40:32.880341 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 257/530] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:32 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:32.911302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:32.913078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:32.923954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:32.924593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:32.925786 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:32.926490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:33.039197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:33.040145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:33.048050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:33.049338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:33.049779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:33.050842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:33.120259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:33.131774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7fea928c-6a2a-4084-89a6-4dc66f0cfc5c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.228386 Jun 21 10:40:33.132617 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 274/531] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:32 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:33.288990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:33.298248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f49dcc50-b73f-4ae4-813a-2bd2595488d5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1271 microversion: 2.1 time: 0.265101 Jun 21 10:40:33.300019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 258/532] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:33 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:33.901057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:33.902361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:33.914237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:33.915398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:33.917004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:33.918534 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.115122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:34.131861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dad839fb-6c35-418a-b4fa-41a2975577fc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.236741 Jun 21 10:40:34.132927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 275/533] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:33 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:34.150276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:34.151820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:34.160698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:34.161855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.163067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:34.163621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.319513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:34.320483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:34.328673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:34.329282 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.330290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:34.330876 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.503066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:34.515488 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-74cfe893-8bf3-4e98-8680-1e1f6e412979 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.200277 Jun 21 10:40:34.517081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 276/534] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:34 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:34.537794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8a56bb73-bb68-468e-89ff-36cf1c969732 req-d8a528b6-067b-459b-aacd-1a89c19715fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:34.556172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8a56bb73-bb68-468e-89ff-36cf1c969732 req-d8a528b6-067b-459b-aacd-1a89c19715fb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:34.558393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8a56bb73-bb68-468e-89ff-36cf1c969732 req-d8a528b6-067b-459b-aacd-1a89c19715fb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:34.581283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8a56bb73-bb68-468e-89ff-36cf1c969732 req-d8a528b6-067b-459b-aacd-1a89c19715fb service nova] Creating event network-changed:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:40:34.590038 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8a56bb73-bb68-468e-89ff-36cf1c969732 req-d8a528b6-067b-459b-aacd-1a89c19715fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070893 Jun 21 10:40:34.591083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 277/535] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:34.652970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:34.669884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5d90543c-134e-486f-bf18-5da3a435c1b9 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1318 microversion: 2.1 time: 0.523880 Jun 21 10:40:34.670879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 259/536] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:34 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:35.160605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:35.161314 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:35.169331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.169969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.170964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.171485 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.336119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:35.351367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-46a11f2a-6703-4407-90a5-1d134f8283f7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.195705 Jun 21 10:40:35.352434 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 278/537] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:35 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:35.541103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:35.541988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:35.549138 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.549618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.550405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.550866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.694788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:35.695875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:35.704328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.705285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.706532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.707255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.782022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:35.791811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1f5f6223-557b-4513-976f-ef05efd99687 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.254698 Jun 21 10:40:35.792339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 260/538] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:35 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:35.912177 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:35.920186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c815dae0-7647-4ec0-9624-d63f5644f86c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1507 microversion: 2.1 time: 0.230107 Jun 21 10:40:35.920778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 279/539] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:35 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:35.937275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ddb5c41-cfef-4e03-9e46-f7e3477e970e", "device": "/dev/sdb"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:35.938540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:35.945512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.945944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:35.946769 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:35.947196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:36.377483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:36.378237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:36.385759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:36.386374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:36.387372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:36.387809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:36.551004 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:36.564298 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b960feef-6ec8-4cc5-8f87-e727eed3cc69 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.191078 Jun 21 10:40:36.564891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 280/540] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:36 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:36.812054 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:36.812677 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:36.821517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:36.822303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:36.823343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:36.824035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:36.952356 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:36.984310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=12 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:37.006593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:37.015028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-25d06144-9331-4a5d-980d-28e9349a5b58 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.206956 Jun 21 10:40:37.015723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 281/541] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:36 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:37.367234 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=4 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:37.581755 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:37.582378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:37.590229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:37.590666 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:37.591461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:37.591894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:37.762989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:37.772809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d464fa23-0252-4177-aa69-6747fede66f4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.195161 Jun 21 10:40:37.773397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 282/542] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:37 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:37.942537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-94f553e1-54f8-4fb4-b84b-62710e5794d7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "POST /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.008995 Jun 21 10:40:37.943468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 261/543] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:40:35 2022] POST /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2/os-volume_attachments => generated 194 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:38.033600 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:38.034437 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:38.041399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:38.041840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:38.043046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:38.043046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:38.235289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:38.244188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b270daf2-1f8e-460f-9b1d-cb74139c4a60 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.215455 Jun 21 10:40:38.245197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 283/544] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:38 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:38.792387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:38.793076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:38.800317 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:38.800799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:38.801577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:38.802004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:39.018251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:39.026947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cb79ff01-fb0a-436f-8f64-ae32c1f07eca tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.239705 Jun 21 10:40:39.027525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 262/545] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:38 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:39.264670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:39.265528 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:39.277783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:39.278657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:39.279837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:39.280555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:39.463635 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:39.472251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6ee5c583-4f3e-4a4f-a61f-5ff385aba4bd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.213733 Jun 21 10:40:39.472850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 284/546] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:39 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:40.174789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:40.175898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:40.186867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:40.187595 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:40.189143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:40.190080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:40.393813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:40.402752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-843c10c3-4ab6-4788-ae90-152b5dbac2e7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.361071 Jun 21 10:40:40.403388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 263/547] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:40 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:40.498513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:40.499264 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:40.506307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:40.506759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:40.507540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:40.507974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:40.670660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:40.678967 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9299be82-15d9-49ef-b301-0421d324d278 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.184369 Jun 21 10:40:40.679497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 285/548] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:40 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:41.420377 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:41.421008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:41.428678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:41.429036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:41.429856 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:41.430327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:41.573190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:41.582299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-71f1fc21-1169-4519-a0e0-faf01e045939 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.166029 Jun 21 10:40:41.582868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 264/549] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:41 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:41.696165 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:41.696740 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:41.704393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:41.704996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:41.705784 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:41.706260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:41.856282 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:41.864539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-58790629-5871-40d7-8c90-4e7e4c63e075 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.172287 Jun 21 10:40:41.865125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 286/550] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:41 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:42.600788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:42.601500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:42.608727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:42.609272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:42.610337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:42.610906 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:42.766884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:42.775283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-36b70a5a-9084-4f72-a695-8309f1b73c43 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.178531 Jun 21 10:40:42.775858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 265/551] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:42 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:42.882195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:42.882804 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:42.889731 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:42.890204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:42.890961 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:42.891426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:43.055759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:43.070236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-590a40f6-9c7b-48d7-a420-61720454191c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.191536 Jun 21 10:40:43.070837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 287/552] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:42 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:43.793509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:43.794240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:43.801592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:43.802038 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:43.802860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:43.803294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:43.944714 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:43.953195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bb233ae7-4291-4aae-8db1-bf77179e25a2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.163946 Jun 21 10:40:43.953766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 266/553] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:43 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:44.091132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:44.091730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:44.101382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:44.101833 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:44.102834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:44.103398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:44.258803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:44.267339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-190a757d-52a3-43e7-9a0b-327e035a8416 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.182064 Jun 21 10:40:44.267951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 288/554] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:44 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:44.972182 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:44.973039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:44.980203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:44.980646 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:44.981402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:44.981860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:45.134671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:45.146583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-601215df-3d0a-4119-8868-193f66c02029 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.179143 Jun 21 10:40:45.147482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 267/555] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:44 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:45.285021 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:45.285644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:45.293670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:45.294113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:45.294930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:45.295360 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:45.444395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:45.452642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0abaceb4-d31d-47ed-bb9e-674f28dc7eae tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.171836 Jun 21 10:40:45.453230 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 289/556] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:45 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:46.167606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:46.168230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:46.176502 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:46.176940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:46.177707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:46.178147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:46.322038 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:46.331019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8025ae94-bf1d-4370-9a69-4ed89e427524 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.167380 Jun 21 10:40:46.331614 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 268/557] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:46 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:46.469367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:46.470680 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:46.473159 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:46.478753 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:46.479195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:46.479965 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:46.480396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:46.633011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:46.636571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:46.642412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1080f016-d1a7-41a6-9b48-fd98e43bcc98 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.176152 Jun 21 10:40:46.643023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 290/558] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:46 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:47.351263 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:47.352018 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:47.359485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:47.360070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:47.360896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:47.361328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:47.517992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:47.526613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b628de1f-aa6d-47c1-867c-5afa740c99e2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1723 microversion: 2.1 time: 0.180508 Jun 21 10:40:47.527215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 269/559] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:47 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:47.661748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:47.662405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:47.669871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:47.670378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:47.671157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:47.671611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:47.823730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:47.833173 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cdd1be82-b3f2-42e5-b42b-7edcd56ca2c6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.175651 Jun 21 10:40:47.833827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 291/560] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:47 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:48.545110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:48.545696 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:48.553246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.553695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.554516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.554948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.707966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:48.716718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d51cfc59-5162-41dd-bc7f-9095e500d434 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1700 microversion: 2.1 time: 0.175808 Jun 21 10:40:48.717674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 270/561] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:48 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:48.739903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e2dc3f10-3b6a-4140-bb85-424f4989f9b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:48.755704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2dc3f10-3b6a-4140-bb85-424f4989f9b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.756744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e2dc3f10-3b6a-4140-bb85-424f4989f9b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.792813 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e2dc3f10-3b6a-4140-bb85-424f4989f9b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Going to try to start instance {{(pid=124179) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 10:40:48.846867 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e2dc3f10-3b6a-4140-bb85-424f4989f9b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.115880 Jun 21 10:40:48.847578 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 292/562] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:40:48 2022] POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:40:48.852436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:48.853451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:48.860422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:48.861635 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:48.863698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.864435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.865741 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.866541 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.870615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.871350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:48.872253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:48.872653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:49.027201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:49.037566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6741d585-95fc-4b76-9b45-3765a48a26ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.185106 Jun 21 10:40:49.046275 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 293/563] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:48 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:49.064288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:49.075203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d53e9131-1fa2-4e0e-995c-69d591b9fefd tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.228141 Jun 21 10:40:49.075802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 271/564] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:48 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:50.056597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:50.057087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:50.065463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:50.065463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:50.065463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:50.070089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:50.092860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:50.093462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:50.097604 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=64 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:50.102177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:50.102934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:50.103866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:50.104299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:50.111077 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:50.244685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:50.263654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:50.267858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9e23688b-867d-44ba-95fd-c9f1fa0af2bf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.215822 Jun 21 10:40:50.268996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 294/565] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:50 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:50.284218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1e7083d0-c1f5-4877-8f2b-938ac6ef1def tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.194631 Jun 21 10:40:50.285417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 272/566] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:50 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:51.292921 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:51.293714 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:51.300825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:51.301272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:51.302088 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:51.302550 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:51.305026 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:51.306315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:51.316998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:51.317455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:51.318292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:51.318924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:51.476811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:51.480157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:51.485853 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4fccb0b7-1ef9-4eef-b9c9-7163aafecb91 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.188268 Jun 21 10:40:51.486481 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 273/567] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:51 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:51.488726 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-49180a02-c67b-47b7-9a02-06dc73e10d7d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.200376 Jun 21 10:40:51.489348 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 295/568] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:51 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:52.503060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:52.503708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:52.507091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:52.507703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:52.513101 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:52.513564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:52.514417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:52.514872 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:52.515062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:52.515357 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:52.516482 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:52.516926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:52.702733 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:52.713901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-186ec6d2-1ea0-4bd6-a1e9-4f4f833df78c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.210665 Jun 21 10:40:52.714651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 296/569] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:52 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:52.715034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:52.723972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2908f069-ea00-4a6b-b24a-d97344d74b41 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.224896 Jun 21 10:40:52.724565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 274/570] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:52 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:53.735530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:53.736153 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:53.742019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:53.742755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:53.743337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:53.743805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:53.744552 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:53.745023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:53.749578 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:53.750028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:53.750812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:53.751931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:53.903195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:53.907062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:53.912480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0a373de4-3832-43dc-a57d-03e84a46d879 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.180817 Jun 21 10:40:53.913151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 297/571] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:53 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:53.917569 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-17f26b88-a74f-4d11-9961-71ff937d86f4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.179274 Jun 21 10:40:53.918143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 275/572] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:53 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:54.931904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:54.932500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:54.935272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:54.936009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:54.940646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:54.941097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:54.941877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:54.942346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:54.943098 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:54.943562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:54.944316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:54.944784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:55.087575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:55.096739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-38808420-2b6b-414e-9169-1b5c901cc6b0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.168720 Jun 21 10:40:55.097320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 298/573] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:54 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:55.097894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:55.105708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fffb49a5-8c3a-4750-8eb2-6f188edfb120 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.174222 Jun 21 10:40:55.106299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 276/574] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:54 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:56.114307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:56.115232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:56.121954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:56.122317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:56.123083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:56.123514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:56.127777 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:56.128876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:56.138477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:56.139182 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:56.140485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:56.141096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:56.291411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:56.301740 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0edbf832-8dba-4d05-8679-4eeb74fb39bb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1709 microversion: 2.1 time: 0.191379 Jun 21 10:40:56.302890 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 299/575] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:56 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:56.325316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:56.333521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-661c3a46-9e4f-4c99-a811-ec26717d9be2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.214226 Jun 21 10:40:56.334138 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 277/576] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:56 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:57.320982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:57.321684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:57.330356 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:57.331238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:57.332033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:57.332473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:57.352074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:57.352805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:57.360459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:57.360960 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:57.361948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:57.362456 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:57.489913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:57.499057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5bdcab80-c4fb-4081-971e-563f3be2d2c5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1713 microversion: 2.1 time: 0.182878 Jun 21 10:40:57.499645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 300/577] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:57 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1713 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:57.526387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:57.534837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8faddb95-d4e8-4657-8bca-41601555b7b1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.187901 Jun 21 10:40:57.535463 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 278/578] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:57 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:40:58.289016 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-3ec2c111-ad3f-4aeb-a1ba-09c49df9da18 req-b6d1fe12-d70e-4567-9d65-7a5c8f9e4083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "name": "network-vif-plugged", "status": "completed", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:40:58.298894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3ec2c111-ad3f-4aeb-a1ba-09c49df9da18 req-b6d1fe12-d70e-4567-9d65-7a5c8f9e4083 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:58.299447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3ec2c111-ad3f-4aeb-a1ba-09c49df9da18 req-b6d1fe12-d70e-4567-9d65-7a5c8f9e4083 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:58.313727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-3ec2c111-ad3f-4aeb-a1ba-09c49df9da18 req-b6d1fe12-d70e-4567-9d65-7a5c8f9e4083 service nova] Creating event network-vif-plugged:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:40:58.319330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-3ec2c111-ad3f-4aeb-a1ba-09c49df9da18 req-b6d1fe12-d70e-4567-9d65-7a5c8f9e4083 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034702 Jun 21 10:40:58.320136 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 301/579] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:40:58.553027 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:58.553672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:58.560066 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:58.560529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:58.561311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:58.561734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:58.794530 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:40:58.802880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9fcc58e5-7f16-4bd3-bb58-f6893c065125 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.254408 Jun 21 10:40:58.803465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 279/580] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:58 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:40:59.824391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:40:59.825601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:40:59.838166 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:59.838943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:40:59.840237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:40:59.840989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:00.005664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:00.013857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d97cc58-57a8-404c-b217-f69495da0b9d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.197176 Jun 21 10:41:00.014513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 302/581] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:40:59 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:01.030783 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:01.031439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:01.039320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:01.039757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:01.040526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:01.040951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:01.186318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:01.194492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7d8bd70f-b9f3-4445-bd73-31bb22ff0d14 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.167507 Jun 21 10:41:01.195175 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 280/582] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:01 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:02.212420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:02.213140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:02.220667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:02.221095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:02.221883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:02.222361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:02.372746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:02.381742 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-73ccab04-cf45-458a-9c2e-3c6ee9e8e2a0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.173250 Jun 21 10:41:02.382376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 303/583] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:02 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:03.400845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:03.402029 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:03.408891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:03.409338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:03.410131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:03.410564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:03.570507 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:03.579088 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-38110128-9088-4c3f-b789-60255b226d5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.182029 Jun 21 10:41:03.579740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 281/584] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:03 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:04.597154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:04.597834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:04.605817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:04.606370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:04.607216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:04.607728 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:04.762528 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:04.771161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7fdb22f1-3e05-40ca-a929-21484e438a06 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.178690 Jun 21 10:41:04.771713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 304/585] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:04 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:05.788580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:05.789225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:05.796272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:05.796722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:05.797489 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:05.797893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:05.947323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:05.956421 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-aa4e0668-eced-420f-86d4-bb940bfd3711 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.171574 Jun 21 10:41:05.957107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 282/586] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:05 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:06.980585 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:06.981608 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:06.990366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:06.990820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:06.991595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:06.992021 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:07.141171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:07.149090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-66a80343-1174-4545-9366-c12beaa52fa6 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.177009 Jun 21 10:41:07.149640 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 305/587] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:06 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:08.166465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:08.167215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:08.174090 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:08.174562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:08.175319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:08.175738 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:08.336704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:08.345298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5b02abf4-7e76-4290-a970-0d82dc3fab7f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.182670 Jun 21 10:41:08.345897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 283/588] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:08 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:09.372853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:09.373807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:09.380859 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:09.381314 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:09.382155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:09.382625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:09.549864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:09.558378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-31213dae-dd77-43b0-939b-8770c4faebc5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1259 microversion: 2.1 time: 0.190634 Jun 21 10:41:09.558975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 306/589] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:09 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:10.580834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:10.581546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:10.588380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:10.588809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:10.589643 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:10.590090 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:10.742808 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:10.751469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-002c2503-92d3-4521-af5a-6dc5b535a75c tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1444 microversion: 2.1 time: 0.176060 Jun 21 10:41:10.752060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 284/590] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:10 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:10.768660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:10.769285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:10.776241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:10.776696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:10.777483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:10.777924 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:10.782515 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:10.926231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:10.936347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e9029429-f85e-47bd-b662-9ff93792990a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1444 microversion: 2.1 time: 0.171649 Jun 21 10:41:10.937133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 307/591] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:10 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:12.079881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:12.080524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:12.087514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:12.088063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:12.088915 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:12.089451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:12.221571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lazy-loading 'services' on Instance uuid 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:41:12.377474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0c38df00-aff5-4827-a7c3-8a409cb57f07 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2/os-volume_attachments/4ddb5c41-cfef-4e03-9e46-f7e3477e970e" status: 202 len: 0 microversion: 2.1 time: 0.300875 Jun 21 10:41:12.380375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 285/592] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:41:12 2022] DELETE /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2/os-volume_attachments/4ddb5c41-cfef-4e03-9e46-f7e3477e970e => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:41:13.233442 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5c0bd9cb-e564-4f8e-bffc-4a6169c9fe95 req-f869d926-2389-4b45-9b68-ccef1c38b261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:41:13.243523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5c0bd9cb-e564-4f8e-bffc-4a6169c9fe95 req-f869d926-2389-4b45-9b68-ccef1c38b261 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:13.244071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5c0bd9cb-e564-4f8e-bffc-4a6169c9fe95 req-f869d926-2389-4b45-9b68-ccef1c38b261 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:13.256651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5c0bd9cb-e564-4f8e-bffc-4a6169c9fe95 req-f869d926-2389-4b45-9b68-ccef1c38b261 service nova] Creating event network-changed:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:41:13.261996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5c0bd9cb-e564-4f8e-bffc-4a6169c9fe95 req-f869d926-2389-4b45-9b68-ccef1c38b261 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107301 Jun 21 10:41:13.263444 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 308/593] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:41:14.643241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:14.643828 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:14.651142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:14.651582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:14.652354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:14.652784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:14.678588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:41:14.735491 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:14.782551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2726251c-a8e8-4ce3-b6d6-14042906f75f tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 204 len: 0 microversion: 2.1 time: 0.142974 Jun 21 10:41:14.783164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 286/594] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:41:14 2022] DELETE /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:41:14.793599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:14.794823 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:14.802124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:14.802681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:14.803688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:14.804325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:14.945438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:14.954187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-651798c3-a4c9-465f-85cd-9e3491398ab4 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1513 microversion: 2.1 time: 0.165875 Jun 21 10:41:14.954727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 309/595] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:14 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:15.972647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:15.973372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:15.980047 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:15.980493 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:15.981274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:15.981700 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:16.117028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:16.125479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9ac194c6-29dc-407a-a8c5-7546cf40ea9c tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1513 microversion: 2.1 time: 0.157195 Jun 21 10:41:16.126080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 287/596] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:15 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:17.142910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:17.143572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:17.146022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=40 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:17.151483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:17.151933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:17.152713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:17.153138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:17.295392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:17.303395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-56be99af-b26e-4ec5-adf7-15e0020c3008 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1513 microversion: 2.1 time: 0.164733 Jun 21 10:41:17.303824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 310/597] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:17 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:17.945047 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-55ff708b-f10a-40ba-a6f5-12753417b7a8 req-78989727-a399-4d03-8cac-0f3e8f95594d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ffa1c54-3631-44e0-bbd6-0d4793a066e2", "name": "network-vif-deleted", "tag": "f34d100e-af0e-43b7-989b-ac0978af2874"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:41:17.956685 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-55ff708b-f10a-40ba-a6f5-12753417b7a8 req-78989727-a399-4d03-8cac-0f3e8f95594d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:17.957117 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-55ff708b-f10a-40ba-a6f5-12753417b7a8 req-78989727-a399-4d03-8cac-0f3e8f95594d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:17.969920 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-55ff708b-f10a-40ba-a6f5-12753417b7a8 req-78989727-a399-4d03-8cac-0f3e8f95594d service nova] Creating event network-vif-deleted:f34d100e-af0e-43b7-989b-ac0978af2874 for instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 on hv-cinder-83697 Jun 21 10:41:17.978099 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-55ff708b-f10a-40ba-a6f5-12753417b7a8 req-78989727-a399-4d03-8cac-0f3e8f95594d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036997 Jun 21 10:41:17.978762 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 288/598] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:41:18.322704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:18.323577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:18.332110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:18.332715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:18.333689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:18.334278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:18.376262 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:18.376636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:18.377108 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lazy-loading 'fault' on Instance uuid 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:41:18.428224 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb8cf247b6b4d6981191b804790f5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849b037f3f424220b53da5537c2cebf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:41:18.437631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dce7a50c-41c7-4aa0-9539-9ec6bd74b6c7 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 200 len: 1308 microversion: 2.1 time: 0.119528 Jun 21 10:41:18.438257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 311/599] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:18 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:41:19.456474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:41:19.457177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] [instance: 9ffa1c54-3631-44e0-bbd6-0d4793a066e2] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:41:19.464921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:19.465367 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:19.466214 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:41:19.466640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:41:19.482043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] HTTP exception thrown: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Request method failure captured: Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 HTTP/1.1 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ9qMEixFHDEuBBWYBj24CFItA-aE-ESKltlK71Xyw6nL8wHhpN0Yrqc0ZqnO2_dO5GxDe54GQ6xWa1Ydf_ZLu2E4Sx_VNk-GOwz7v41AUv1WFN2AxfBqDff0SHc9FElTCUy5LHaBvn0vOUhbU1eVbTUkBvQKRcNv0P_XnNXcVj8Lz0 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 849b037f3f424220b53da5537c2cebf3 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:41:19.484245 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/849b037f3f424220b53da5537c2cebf3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_849b037f3f424220b53da5537c2cebf3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/849b037f3f424220b53da5537c2cebf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/849b037f3f424220b53da5537c2cebf3"}]}] Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 849b037f3f424220b53da5537c2cebf3 Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-797128761 Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesSnapshotTestJSON-797128761-project Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 3eb8cf247b6b4d6981191b804790f5f0 Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesSnapshotTestJSON-797128761-project Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. Jun 21 10:41:19.486635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '9ffa1c54-3631-44e0-bbd6-0d4793a066e2'} Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:41:19.487943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. Jun 21 10:41:19.490629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:41:19.493446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] Returning 404 to user: Instance 9ffa1c54-3631-44e0-bbd6-0d4793a066e2 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:41:19.493446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1818a6fe-cdae-4d96-a87d-349a4dbde653 tempest-VolumesSnapshotTestJSON-797128761 tempest-VolumesSnapshotTestJSON-797128761-project] 10.222.0.43 "GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2" status: 404 len: 111 microversion: 2.1 time: 0.033874 Jun 21 10:41:19.493446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 289/600] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:41:19 2022] GET /compute/v2.1/servers/9ffa1c54-3631-44e0-bbd6-0d4793a066e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:42:04.429074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=5 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:04.430236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=26 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:04.699148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Action: 'create', calling method: .version_select at 0x7f8a35d89af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-396547085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHeXopp5isWb1cWbv0q6hxXjn8eTE9b9lNhpZy0IZUFY1MuQY0W/VaCR6XrWOYclEzEY87Zi5sUex8dciNPXg9NVMhP9WGh6Ko8kG5O6hh5ENMsBhJkFu++vcyORyzgZQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:04.716286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for project 25adacdcc5b44375b112a93f8623802c. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:42:04.720893 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for user f9eaebabd54a45a29f262b67fe1c433b and project 25adacdcc5b44375b112a93f8623802c. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:42:04.735237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [65ac043b-77b4-404b-83f2-22381b21b68a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:42:05.744446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [65ac043b-77b4-404b-83f2-22381b21b68a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 50374. Jun 21 10:42:05.767438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-058f9f0d-439a-4c24-bd6f-e33d63553d77 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.338483 Jun 21 10:42:05.773553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 312/601] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:42:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:42:30.039731 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:30.040452 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:30.045370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-438548767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-396547085", "security_groups": [{"name": "tempest-secgroup-smoke-21708833"}], "block_device_mapping_v2": [{"uuid": "80f03169-9bc9-4312-baaa-39ce6fc98ade", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "093916b0-2043-4c85-8617-0988f1b9e421"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:30.185513 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] validate_networks() for [('093916b0-2043-4c85-8617-0988f1b9e421', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:42:30.730995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:42:30.731540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:42:30.732023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:42:30.732526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:42:30.733042 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:42:30.743236 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:30.743680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:30.744476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:30.744908 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:30.764273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:42:30.769107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for user f9eaebabd54a45a29f262b67fe1c433b and project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:42:30.832709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:42:30.834869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80f03169-9bc9-4312-baaa-39ce6fc98ade',volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:42:30.978104 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4887469a-615d-4277-9f7c-853415eee78c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.940279 Jun 21 10:42:30.978850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 290/602] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:42:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:42:30.986862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:30.987629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:30.995283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3c5ccf28-c7fd-4e08-b22f-fc1f00f38b1f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:30.995986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3c5ccf28-c7fd-4e08-b22f-fc1f00f38b1f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:31.057883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3c5ccf28-c7fd-4e08-b22f-fc1f00f38b1f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:31.066448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3c5ccf28-c7fd-4e08-b22f-fc1f00f38b1f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1093 microversion: 2.1 time: 0.080907 Jun 21 10:42:31.067026 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 313/603] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:30 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:32.087049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:32.087680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:32.097453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:32.097880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:32.098704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:32.099108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:32.168079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:32.176184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dd1bf994-a828-4636-aa8e-ed48e35474a1 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1191 microversion: 2.1 time: 0.095024 Jun 21 10:42:32.176753 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 291/604] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:32 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:32.456548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbe8ba57-f3be-460c-9aea-bb3690250fb4"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:32.457690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:32.464719 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:32.465165 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:32.465949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:32.466796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:32.763140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fae72bb8-6998-4851-9f1d-ad8339422ad9 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531040 Jun 21 10:42:32.763902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 314/605] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:42:32 2022] POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:42:33.196975 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:33.200209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:33.212326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:33.213686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:33.215544 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:33.217427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:33.528318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:33.536967 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ab0e121c-3054-4a48-8ce9-54a616ff5657 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1275 microversion: 2.1 time: 0.346841 Jun 21 10:42:33.537571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 292/606] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:33 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:34.063186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-2ff60103-b5f0-413f-9c40-8360144434f5 req-b6552c36-8f55-4ef9-988e-a26f85be2512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b3df2f-73ff-43d7-b18e-76d349dd118d", "tag": "dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:34.074795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2ff60103-b5f0-413f-9c40-8360144434f5 req-b6552c36-8f55-4ef9-988e-a26f85be2512 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:34.075520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2ff60103-b5f0-413f-9c40-8360144434f5 req-b6552c36-8f55-4ef9-988e-a26f85be2512 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:34.089476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-2ff60103-b5f0-413f-9c40-8360144434f5 req-b6552c36-8f55-4ef9-988e-a26f85be2512 service nova] Creating event network-changed:dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd for instance 18b3df2f-73ff-43d7-b18e-76d349dd118d on hv-cinder-83697 Jun 21 10:42:34.095400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-2ff60103-b5f0-413f-9c40-8360144434f5 req-b6552c36-8f55-4ef9-988e-a26f85be2512 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039577 Jun 21 10:42:34.096084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 315/607] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:42:34.554149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:34.555020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:34.563177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:34.563767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:34.564690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:34.565209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:34.802013 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:34.810854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c183d51c-4b48-4eb8-b583-64a4df9e60ff tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.260742 Jun 21 10:42:34.811863 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 293/608] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:34 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:35.830369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:35.831025 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:35.837893 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:35.838361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:35.839088 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:35.839548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:35.979780 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:35.988744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2f0d1c7e-6511-4821-8e79-b69ade2ac82a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.163332 Jun 21 10:42:35.989308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 316/609] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:35 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:37.006234 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:37.006913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:37.014381 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:37.014928 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:37.015689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:37.016145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:37.164395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:37.173560 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-acfc47d5-0c8d-4505-a85f-74fc2b40b371 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.171223 Jun 21 10:42:37.174153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 294/610] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:37 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:38.192931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:38.193812 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:38.203752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:38.204199 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:38.204984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:38.205421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:38.354135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:38.365856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d9a95356-8c85-4b27-a187-bd39651d2e1a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.176435 Jun 21 10:42:38.366540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 317/611] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:38 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:39.385572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:39.386192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:39.393147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:39.393602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:39.394557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:39.395241 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:39.542681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:39.550446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6313ad98-464b-4959-8876-ab6fe2403153 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.168803 Jun 21 10:42:39.551115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 295/612] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:39 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:40.568194 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:40.568866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:40.576230 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:40.576690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:40.577468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:40.577909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:40.717299 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:40.728815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f7d9f19f-72c0-439e-b205-c65a87c9f3a2 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.164919 Jun 21 10:42:40.729563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 318/613] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:40 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:41.746231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:41.746961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:41.749394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:41.750324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:41.756874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:41.757350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:41.758153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:41.758586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:41.908542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:41.917362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-01aa8f4a-f3e9-478d-9310-b4b9b6d65c32 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.175099 Jun 21 10:42:41.917951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 296/614] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:41 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:42.934325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:42.935132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:42.936930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:42.943162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:42.943601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:42.944391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:42.944846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:43.115195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:43.124331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ad8de8a1-a9dd-4c39-bb5a-f0e9182c49db tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.193890 Jun 21 10:42:43.124898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 319/615] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:42 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:44.148307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:44.149023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:44.155815 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:44.156259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:44.157030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:44.157460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:44.303938 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:44.312178 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dd4de810-18fd-4fff-ace2-c61f2f6e4b9c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.167966 Jun 21 10:42:44.312729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 297/616] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:44 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:44.940525 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:44.941146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:44.948008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:44.948456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:44.949619 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:44.950054 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:45.045300 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lazy-loading 'services' on Instance uuid 41dcf0af-2c3f-40a6-82a7-86f4be479e9e {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:42:45.128357 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-674cb012-aca9-4fed-8277-108a182349b9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments/48eb9054-79ac-4c81-9cea-381e363269c3" status: 202 len: 0 microversion: 2.1 time: 0.191716 Jun 21 10:42:45.128954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 320/617] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:42:44 2022] DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments/48eb9054-79ac-4c81-9cea-381e363269c3 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:42:45.331388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:45.331991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:45.339728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:45.340173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:45.341093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:45.341670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:45.487711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:45.495614 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ec066ba7-3366-4580-acad-91bef640907c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.168130 Jun 21 10:42:45.496155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 298/618] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:45 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:46.514689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:46.515382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:46.522527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:46.523091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:46.523892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:46.524457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:46.681916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:46.690258 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d63bf3a1-83d3-4a50-95cd-4c04a42e0203 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.180363 Jun 21 10:42:46.690830 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 321/619] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:46 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:47.708948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:47.710624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:47.718384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:47.739107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:47.740025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:47.740476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:47.803649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:47.805504 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:47.812333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:47.813090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:47.813875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:47.814516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:47.851696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lazy-loading 'flavor' on Instance uuid f5a140be-30bd-4bd7-9530-9b350be9b8ef {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:42:47.955620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:47.967298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c05c60b5-35c2-4c9a-8a0a-8333f383bbd0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.261872 Jun 21 10:42:47.979914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 299/620] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:47 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:48.037260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2bd55fc1-b921-4430-b8fa-a204de19a081 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/action" status: 200 len: 32 microversion: 2.1 time: 0.237548 Jun 21 10:42:48.038478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 322/621] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:42:47 2022] POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 10:42:48.047823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:48.048431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:48.055668 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.056288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.057207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.057773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.210463 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:48.218875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-aa05f3c8-8a59-494f-af85-eabc2585e18f tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.175147 Jun 21 10:42:48.219482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 300/622] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:48 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:48.407074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cb1b8282-d5d2-47ed-a95a-8cf9ee78a806 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:48.417006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb1b8282-d5d2-47ed-a95a-8cf9ee78a806 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.417820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cb1b8282-d5d2-47ed-a95a-8cf9ee78a806 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.451118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cb1b8282-d5d2-47ed-a95a-8cf9ee78a806 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Going to try to stop instance {{(pid=124179) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 10:42:48.496523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cb1b8282-d5d2-47ed-a95a-8cf9ee78a806 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.094731 Jun 21 10:42:48.497211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 323/623] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:42:48 2022] POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:42:48.512718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:48.513605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:48.520996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.521439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.522303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.523519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.707444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:48.716836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-31890af4-6e2a-42aa-966b-1be29dcbd8dc tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.214918 Jun 21 10:42:48.717544 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 301/624] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:48 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:48.987815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:48.988663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:48.996183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.996980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:48.997786 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:48.998307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.169053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:49.179878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1b30dd59-6016-4f8b-95c4-5abab0d5303f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.196838 Jun 21 10:42:49.180472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 324/625] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:48 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:49.239776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:49.240404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:49.252034 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:49.252492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.253322 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:49.253761 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.284997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-0fe7d36e-2212-41d4-adb8-cb06855876f1 req-6f9533aa-c3c5-415f-8010-4ade4730decb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b3df2f-73ff-43d7-b18e-76d349dd118d", "name": "network-vif-plugged", "status": "completed", "tag": "dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:49.295933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-0fe7d36e-2212-41d4-adb8-cb06855876f1 req-6f9533aa-c3c5-415f-8010-4ade4730decb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:49.297046 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-0fe7d36e-2212-41d4-adb8-cb06855876f1 req-6f9533aa-c3c5-415f-8010-4ade4730decb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.332609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-0fe7d36e-2212-41d4-adb8-cb06855876f1 req-6f9533aa-c3c5-415f-8010-4ade4730decb service nova] Creating event network-vif-plugged:dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd for instance 18b3df2f-73ff-43d7-b18e-76d349dd118d on hv-cinder-83697 Jun 21 10:42:49.348283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-0fe7d36e-2212-41d4-adb8-cb06855876f1 req-6f9533aa-c3c5-415f-8010-4ade4730decb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158977 Jun 21 10:42:49.349358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 302/626] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:42:49.443770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:49.453865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-71d40179-8655-4bf4-9d73-d65ee3a2129e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.218043 Jun 21 10:42:49.454473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 325/627] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:49 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:49.738453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:49.739150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:49.745968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:49.746438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.747228 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:49.747675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:49.924040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:49.932487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd74b78f-78a8-415a-a824-cab08593a34a tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.200617 Jun 21 10:42:49.933086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 303/628] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:49 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:42:50.198203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:50.199285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:50.207413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.207854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:50.208651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.209083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:50.214650 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:50.392233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:50.401507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e113ebaf-58f9-4079-a139-fddbd8fd0639 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.208364 Jun 21 10:42:50.402196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 326/629] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:50 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:50.472512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:50.473023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:50.480279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.480703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:50.481502 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.481928 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:50.629638 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:50.638324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a097dc14-5080-4c14-a344-2c33ab9f9ae6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.169906 Jun 21 10:42:50.638887 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 304/630] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:50 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:50.954233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:50.955055 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:50.964197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.964763 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:50.965833 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:50.966365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:51.318167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:51.329185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-edc95109-8225-4a04-bc25-95978758e558 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.381272 Jun 21 10:42:51.329925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 327/631] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:50 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:51.421123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:51.421806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:51.431948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:51.432477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:51.433577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:51.434092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:51.571216 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:51.579257 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9413494f-1f95-40ae-b6cf-a7d97da0a716 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1263 microversion: 2.1 time: 0.164133 Jun 21 10:42:51.579813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 305/632] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:51 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:51.656224 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:51.656839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:51.663463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:51.664020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:51.664828 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:51.665330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:51.800723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:51.810494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-126cf793-ad6f-42b4-9b7f-f06efef64553 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.158220 Jun 21 10:42:51.811068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 328/633] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:51 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:52.350820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:52.351434 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:52.358036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.358582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.359403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.359812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.597129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:52.597762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:52.605344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.605802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.606611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.607070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.749516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:52.757339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5d51c8ad-45f9-4e3e-8ff8-90067d0b2c1e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1450 microversion: 2.1 time: 0.164157 Jun 21 10:42:52.758192 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 329/634] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:52 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:52.758647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:52.767055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f1f92fee-378c-435b-b5af-b76c782757f1 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.421939 Jun 21 10:42:52.767623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 306/635] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:52 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:52.775410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:52.776008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:52.782399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.782850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.783616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.784035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.832115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:52.832749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:52.839534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.839983 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.840764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:52.841194 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:52.927443 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:52.935379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e9f2bfb1-11d5-4de8-97dc-4620c7bdd7bc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1450 microversion: 2.1 time: 0.164314 Jun 21 10:42:52.935963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 330/636] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:52 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:52.986512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:52.992729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:53.001592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5df5965f-71f4-4fbb-b555-75a38182bb6c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.176294 Jun 21 10:42:53.002252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 307/637] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:52 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:42:53.784892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:53.785464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:53.792914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:53.793362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:53.794139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:53.794579 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:54.022805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:54.023817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:54.032005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:54.032449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:54.033226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:54.033724 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:54.042457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:54.051855 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6f85102e-6bb9-48f2-813d-c6e2ea908df0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.270940 Jun 21 10:42:54.052609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 331/638] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:53 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:54.214781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:54.223243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dfb81983-6a35-4fe2-9cc2-b2540cd35b2d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.206240 Jun 21 10:42:54.223860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 308/639] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:54 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:54.983154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-e5fa9b0c-99f3-4182-8977-6e22fb44ba8b req-53c87010-6f37-4690-bebc-57054bc5799e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b3df2f-73ff-43d7-b18e-76d349dd118d", "tag": "dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:42:54.991537 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e5fa9b0c-99f3-4182-8977-6e22fb44ba8b req-53c87010-6f37-4690-bebc-57054bc5799e service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:54.992084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-e5fa9b0c-99f3-4182-8977-6e22fb44ba8b req-53c87010-6f37-4690-bebc-57054bc5799e service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:55.003200 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-e5fa9b0c-99f3-4182-8977-6e22fb44ba8b req-53c87010-6f37-4690-bebc-57054bc5799e service nova] Creating event network-changed:dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd for instance 18b3df2f-73ff-43d7-b18e-76d349dd118d on hv-cinder-83697 Jun 21 10:42:55.008473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-e5fa9b0c-99f3-4182-8977-6e22fb44ba8b req-53c87010-6f37-4690-bebc-57054bc5799e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091510 Jun 21 10:42:55.009263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 332/640] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:42:55.068882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:55.070168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:55.076703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:55.077149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:55.077916 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:55.078424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:55.241658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:55.242877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:55.249577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:55.250444 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:55.251317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:55.251847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:55.311465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:55.321254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fdd945a2-9f39-43a4-a104-8de57dc60b1b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.256229 Jun 21 10:42:55.323190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 309/641] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:55 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:55.402822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:55.414580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-70984605-039a-4ad8-bc78-928634469c51 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.176951 Jun 21 10:42:55.415304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 333/642] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:55 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:56.340489 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:56.341097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:56.348216 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:56.348687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:56.349469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:56.349892 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:56.432925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:56.433553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:56.441092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:56.441682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:56.442760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:56.443574 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:56.502450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:56.510391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8e22016d-0dd5-4613-b211-d49aa3ec4556 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.173824 Jun 21 10:42:56.510984 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 310/643] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:56 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:56.590859 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:56.603229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-63db1c5b-eddb-4567-8643-d0d2509e4005 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.174449 Jun 21 10:42:56.603997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 334/644] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:56 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:57.528364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:57.528934 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:57.535743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:57.536192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:57.536948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:57.537376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:57.625270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:57.625877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:57.633128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:57.633606 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:57.634428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:57.634872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:57.678359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:57.686527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8d3eb0b5-8086-4429-9d1f-ea5e614eb018 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.162148 Jun 21 10:42:57.687097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 311/645] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:57 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:57.775081 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:57.784233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4185571f-6dba-4884-88ae-7290971cfc91 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.162660 Jun 21 10:42:57.784740 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 335/646] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:57 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:58.704533 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:58.705129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:58.711855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:58.712292 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:58.713056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:58.713482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:58.802491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:58.803171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:58.811027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:58.811478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:58.812241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:58.812669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:58.850277 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:58.859548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-542efbf1-69a8-46eb-b7b9-310b817cc063 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.158871 Jun 21 10:42:58.860127 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 312/647] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:58 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:42:58.950417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:42:58.961326 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d94f3b8d-0c44-497a-9675-24a72f5b8ac2 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.162372 Jun 21 10:42:58.962087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 336/648] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:58 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:42:59.876995 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:59.877621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:59.884728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:59.885169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:59.885925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:59.886384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:59.979835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:42:59.980581 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:42:59.987741 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:59.988204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:42:59.988969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:42:59.989377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:00.032708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:00.040654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b4084d47-2614-4094-99e8-0a99c3213993 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.167513 Jun 21 10:43:00.041206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 313/649] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:59 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:00.128274 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:00.137353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3d6f0c5c-d7d7-4059-8ac3-afdf670988e1 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.161643 Jun 21 10:43:00.137949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 337/650] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:42:59 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:01.059537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:01.060238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:01.062724 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:01.071965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:01.072712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:01.074503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:01.075254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:01.154979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:01.155590 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:01.159675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=53 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:01.164936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:01.165380 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:01.166320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:01.166750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:01.236071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:01.245176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-00b49eac-63a7-4978-9052-40accab8271e tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.189622 Jun 21 10:43:01.246697 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 314/651] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:01 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:43:01.362927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:01.372204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9249f4a4-8ba7-42d4-bf62-d65ecacd5679 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.221046 Jun 21 10:43:01.372813 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 338/652] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:01 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:02.264514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:02.265352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:02.272620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:02.273484 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:02.273875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:02.282587 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:02.390413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:02.390993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:02.400420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:02.400883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:02.401776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:02.402514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:02.423720 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:02.431902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4a643ca0-974e-4f2d-9b2b-97a50e6e022b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.171628 Jun 21 10:43:02.432479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 315/653] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:02 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:02.539252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:02.547462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-22525e36-e1f7-474a-99e2-0185bc12b2c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.161094 Jun 21 10:43:02.548061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 339/654] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:02 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:03.450290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:03.450916 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:03.457792 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:03.458262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:03.459059 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:03.459495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:03.564951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:03.565621 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:03.572757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:03.573210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:03.574621 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:03.575047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:03.614776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:03.623330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1cc56016-96c9-4e82-a0d1-4a4c666b03d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1677 microversion: 2.1 time: 0.177339 Jun 21 10:43:03.623906 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 316/655] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:03 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:03.718478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:03.727040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-33df9614-28c8-4a2e-9bb5-44ad6fe8cd60 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.165925 Jun 21 10:43:03.727625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 340/656] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:03 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:04.647627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:04.648303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:04.656436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.656878 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.657661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.658094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.744868 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:04.746174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:04.753076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.753520 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.754311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.754741 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.808929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:04.818333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ac341f0f-cb8b-4c8f-bec6-3f377c40e826 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1654 microversion: 2.1 time: 0.174494 Jun 21 10:43:04.818872 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 317/657] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:04 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:43:04.837423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-04e03da8-f5a8-4511-8f1b-a120b16a354f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:43:04.844082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04e03da8-f5a8-4511-8f1b-a120b16a354f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.844528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-04e03da8-f5a8-4511-8f1b-a120b16a354f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.896766 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:04.907681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50454dd4-8df5-436c-8473-71b3712ad1f8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.166471 Jun 21 10:43:04.908139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-04e03da8-f5a8-4511-8f1b-a120b16a354f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Going to try to start instance {{(pid=124180) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 10:43:04.908347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 341/658] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:04 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:04.956173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-04e03da8-f5a8-4511-8f1b-a120b16a354f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.122938 Jun 21 10:43:04.956966 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 318/659] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:43:04 2022] POST /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:43:04.966218 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:04.967001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:04.973556 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.974010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:04.975172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:04.975388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:05.171443 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:05.180055 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5018f319-e72d-42d4-87f6-333f205fd4ac tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1663 microversion: 2.1 time: 0.217791 Jun 21 10:43:05.180647 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 342/660] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:04 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1663 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:05.927196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:05.927864 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:05.935719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:05.936274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:05.937039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:05.937503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:06.087134 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:06.102188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-186fef2a-473a-4d62-b13d-13cb211f3fbe tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.178957 Jun 21 10:43:06.103237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 319/661] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:05 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:06.197848 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:06.199447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:06.207210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:06.207649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:06.208424 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:06.208853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:06.232015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=100 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:06.353969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:06.362313 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dc061d93-10ef-46fb-a92d-d2f80064ce8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1663 microversion: 2.1 time: 0.168692 Jun 21 10:43:06.362911 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 343/662] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:06 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:07.128238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:07.128817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:07.136131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:07.136551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:07.137307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:07.137743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:07.287092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:07.295581 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd2777f5-4447-4f27-8ec7-afc61e81e7df tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.171352 Jun 21 10:43:07.296142 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 320/663] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:07 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:07.381250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:07.381862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:07.388909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:07.389366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:07.390158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:07.390618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:07.523652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:07.531807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b9ad1d51-e136-4ea1-98a2-f2241042c503 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1667 microversion: 2.1 time: 0.154462 Jun 21 10:43:07.532341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 344/664] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:07 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:08.313806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:08.314415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:08.321617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:08.322075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:08.322849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:08.323385 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:08.468145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:08.477005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7d70e0f0-0e93-46fb-9a66-935fc1a30d5b tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.167098 Jun 21 10:43:08.477580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 321/665] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:08 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:09.494927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:09.496168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:09.502745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:09.503264 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:09.504050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:09.504488 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:09.643242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:09.653913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2c1faa1f-996f-4646-825a-8db1e2a78592 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.162909 Jun 21 10:43:09.655360 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 345/666] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:09 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:10.671721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:10.672400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:10.681945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:10.682584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:10.683828 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:10.684008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:10.838692 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:10.849133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d3a5c6a6-d7d9-48df-9ec1-2886a20d48e6 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.181179 Jun 21 10:43:10.849969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 322/667] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:10 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:43:11.868817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:11.869403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:11.876812 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:11.877256 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:11.878009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:11.878476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:12.017610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:12.026029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2e3604e8-aa7d-4b1b-a37d-4e6cee05173c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1736 microversion: 2.1 time: 0.161118 Jun 21 10:43:12.026642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 346/668] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:11 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:13.045724 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:13.046826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:13.057030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.057641 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.058659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.060556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.079677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:13.193571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:13.205128 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e4cd83aa-93e1-44fc-9603-e701080e7d9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1716 microversion: 2.1 time: 0.165018 Jun 21 10:43:13.205978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 323/669] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:13 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:13.264660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:13.265221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:13.272163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.272610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.273377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.273798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.360139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] HTTP exception thrown: Cannot 'detach_volume' instance f5a140be-30bd-4bd7-9530-9b350be9b8ef while it is in vm_state rescued Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Request method failure captured: Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments/cbe8ba57-f3be-460c-9aea-bb3690250fb4 HTTP/1.1 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ7-0Yr6cnHx4a8u5RPb5PC0EvZ74GC7mZPWTXONMJvOammtEaSDl8VP1qqvHkM2oyVwl8AxBELJpWJ-SmV_6gjbbGrpX7otrWYhWKmBBvXupHK_hyPgmxzZ_4rUh_JL7cdJNXoz9vvEF5y5Wc94ht_61JWEMR00EFB3PMhh7fFJpvg Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:43:13.361778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ddb0def61dd452db3588952af149fb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ddb0def61dd452db3588952af149fb7"}]}] Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 9bbb5d4487874bdd9f82e28651a418f9 Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:43:13.363422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Cannot 'detach_volume' instance f5a140be-30bd-4bd7-9530-9b350be9b8ef while it is in vm_state rescued Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'server_id': 'f5a140be-30bd-4bd7-9530-9b350be9b8ef', 'id': 'cbe8ba57-f3be-460c-9aea-bb3690250fb4'} Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:43:13.364198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f5a140be-30bd-4bd7-9530-9b350be9b8ef while it is in vm_state rescued Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f5a140be-30bd-4bd7-9530-9b350be9b8ef while it is in vm_state rescued Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:43:13.365491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Returning 409 to user: Cannot 'detach_volume' instance f5a140be-30bd-4bd7-9530-9b350be9b8ef while it is in vm_state rescued {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:43:13.366557 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a89777e-b0a6-4067-8fd9-c7df81435499 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments/cbe8ba57-f3be-460c-9aea-bb3690250fb4" status: 409 len: 152 microversion: 2.1 time: 0.103385 Jun 21 10:43:13.366557 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 347/670] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:43:13 2022] DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments/cbe8ba57-f3be-460c-9aea-bb3690250fb4 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:43:13.372970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:43:13.373496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:13.379813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.380374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.381002 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.381425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.459604 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fe289bba-c795-499e-bba8-ce132c7f70e8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.090914 Jun 21 10:43:13.465115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 324/671] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:43:13 2022] POST /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:43:13.470237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:13.470846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:13.478628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.479129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.480073 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:13.480513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:13.619117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:13.628030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e536e73e-5d7b-4145-8d26-5386e5454415 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1724 microversion: 2.1 time: 0.161754 Jun 21 10:43:13.628666 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 348/672] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:13 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:14.647162 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:14.647954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:14.655406 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:14.655859 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:14.656633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:14.657061 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:14.804404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:14.817071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6e6f35cc-fdeb-4d3a-b448-63e5ff9db4f7 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1724 microversion: 2.1 time: 0.174177 Jun 21 10:43:14.817941 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 325/673] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:14 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:15.837270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:15.838070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:15.845426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:15.845876 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:15.846688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:15.847185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:15.983433 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:15.991943 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2bb886d0-92ee-427f-a66c-4bd2e752d494 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1724 microversion: 2.1 time: 0.158748 Jun 21 10:43:15.992514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 349/674] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:15 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:17.011368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:17.012706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:17.019968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:17.020408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:17.021156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:17.021581 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:17.168312 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:43:17.178314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-391dca05-e8d1-4645-a155-1fee27086fce tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1730 microversion: 2.1 time: 0.171267 Jun 21 10:43:17.178940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 326/675] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:43:17 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:43:17.195495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:43:17.196122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:43:17.203290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:17.203746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:17.204507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:17.204941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:17.290509 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-302b1522-a049-44d8-ad56-92f8640dc8eb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098910 Jun 21 10:43:17.291108 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 350/676] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:43:17 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:43:18.441050 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-7f0f6eb0-5d20-4665-b854-225d63281fa8 req-150fe9c4-a793-4ec9-872f-bb7052c5c4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:43:18.450436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7f0f6eb0-5d20-4665-b854-225d63281fa8 req-150fe9c4-a793-4ec9-872f-bb7052c5c4cb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:18.450990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7f0f6eb0-5d20-4665-b854-225d63281fa8 req-150fe9c4-a793-4ec9-872f-bb7052c5c4cb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:18.462978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-7f0f6eb0-5d20-4665-b854-225d63281fa8 req-150fe9c4-a793-4ec9-872f-bb7052c5c4cb service nova] Creating event network-changed:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:43:18.467752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-7f0f6eb0-5d20-4665-b854-225d63281fa8 req-150fe9c4-a793-4ec9-872f-bb7052c5c4cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031734 Jun 21 10:43:18.468345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 327/677] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:43:20.486603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-c170216b-529c-42bc-935a-63e1227338c3 req-7f2b583f-4697-4265-a172-bd8b17c46bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:43:20.498919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c170216b-529c-42bc-935a-63e1227338c3 req-7f2b583f-4697-4265-a172-bd8b17c46bbf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:43:20.499357 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c170216b-529c-42bc-935a-63e1227338c3 req-7f2b583f-4697-4265-a172-bd8b17c46bbf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:43:20.511212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-c170216b-529c-42bc-935a-63e1227338c3 req-7f2b583f-4697-4265-a172-bd8b17c46bbf service nova] Creating event network-changed:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:43:20.516707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-c170216b-529c-42bc-935a-63e1227338c3 req-7f2b583f-4697-4265-a172-bd8b17c46bbf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036409 Jun 21 10:43:20.517326 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 351/678] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:14.495133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=27 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:14.495898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:14.501866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:14.503410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:14.511303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.511647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.512409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.512833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.542757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e7ee551d-519d-4c53-8dc1-bf32db02cd7c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050555 Jun 21 10:44:14.543278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 328/679] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:14 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:44:14.602647 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=27 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:14.603316 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=44 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:14.608491 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:14.609062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:14.616359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.616879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.617661 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.618096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.644684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:44:14.727229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-46c11bd6-e6d3-4022-8ff3-1a535d107ed2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 204 len: 0 microversion: 2.1 time: 0.126018 Jun 21 10:44:14.727883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 352/680] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:44:14 2022] DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:44:14.736501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:14.737106 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:14.743325 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.743781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.744537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:14.744968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:14.888187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:14.896924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c211c3bf-2229-40da-b6fc-6ae8fa99d77b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1673 microversion: 2.1 time: 0.164145 Jun 21 10:44:14.897510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 329/681] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:14 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:15.917832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:15.918566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:15.926798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:15.927375 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:15.928489 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:15.929029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:16.078649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:16.087391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3f50a002-6fc7-47bc-b281-cdc187cdf9d8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1673 microversion: 2.1 time: 0.173848 Jun 21 10:44:16.087990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 353/682] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:15 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:17.109355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:17.109996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:17.117682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:17.118190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:17.119150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:17.119598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:17.309830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:17.318690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d0e47fb5-c48d-4427-a2cc-e795106f31c2 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 200 len: 1605 microversion: 2.1 time: 0.213279 Jun 21 10:44:17.319574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 330/683] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:17 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:17.433563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-624610fc-ee0f-4a7b-ad4c-11924471db11 req-b930239f-7b46-422c-ad9d-706096897f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41dcf0af-2c3f-40a6-82a7-86f4be479e9e", "name": "network-vif-deleted", "tag": "b7baf3ca-b0e6-48a9-976e-a9d0f3332f16"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:17.449090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-624610fc-ee0f-4a7b-ad4c-11924471db11 req-b930239f-7b46-422c-ad9d-706096897f82 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:17.449972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-624610fc-ee0f-4a7b-ad4c-11924471db11 req-b930239f-7b46-422c-ad9d-706096897f82 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:17.468190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-624610fc-ee0f-4a7b-ad4c-11924471db11 req-b930239f-7b46-422c-ad9d-706096897f82 service nova] Creating event network-vif-deleted:b7baf3ca-b0e6-48a9-976e-a9d0f3332f16 for instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e on hv-cinder-83697 Jun 21 10:44:17.476391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-624610fc-ee0f-4a7b-ad4c-11924471db11 req-b930239f-7b46-422c-ad9d-706096897f82 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048944 Jun 21 10:44:17.477536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 354/684] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:18.339780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:18.341206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:18.354337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:18.355599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:18.357230 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:18.358270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:18.383062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e HTTP/1.1 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:44:18.386229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:44:18.387648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '41dcf0af-2c3f-40a6-82a7-86f4be479e9e'} Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:44:18.388501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:44:18.389747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:18.390926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:44:18.390926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-27301a28-cb63-4946-8e6b-be9c262395ae tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 404 len: 111 microversion: 2.1 time: 0.054169 Jun 21 10:44:18.390926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 331/685] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:18 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:44:18.404131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9634e30-8e85-426a-90ff-4524bf411bd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '.version_select at 0x7f8a35e623a0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:18.441746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c9634e30-8e85-426a-90ff-4524bf411bd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848821487" status: 202 len: 0 microversion: 2.1 time: 0.045648 Jun 21 10:44:18.442757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 355/686] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 21 10:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848821487 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:44:19.235569 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c13d942a-3744-474e-8b6c-acf53b9daf90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: .version_select at 0x7f8a366113a0>, body: {"keypair": {"name": "tempest-keypair-1275919704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaBAyp2Fu6J/pJGiM4bcXelCRYJSwLc4xt2VUGLfyZM8sGizMjYw8kEB8XI5PsjOTfUC6UJk7WnCR8fyO6jtMjpjdrnNJjNcgDcWxvenCis9n/DLgVnsngDnfMxo7OUbQ=="}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:19.256310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-c13d942a-3744-474e-8b6c-acf53b9daf90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:44:19.260903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-c13d942a-3744-474e-8b6c-acf53b9daf90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for user f58d6e222d654e66b38fcefeff65fe80 and project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:44:19.302611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c13d942a-3744-474e-8b6c-acf53b9daf90 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070866 Jun 21 10:44:19.303232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 332/687] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:44:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:20.766370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1856351378", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58abac2a-7802-4e63-8ffd-5ef6d3410d2e"}], "security_groups": [{"name": "tempest-securitygroup--333437200"}], "key_name": "tempest-keypair-1275919704", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:20.881802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] validate_networks() for [('58abac2a-7802-4e63-8ffd-5ef6d3410d2e', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:44:21.342764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:44:21.343217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:44:21.343696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:44:21.344104 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:44:21.344550 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:44:21.353885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:21.354397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:21.355206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:21.355642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:21.374172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:44:21.378360 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Getting quotas for user f58d6e222d654e66b38fcefeff65fe80 and project dadbbbf08f7b44ce8594f389765f35b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:44:21.391396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:44:21.393837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:44:21.444026 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-021e89cf-cdcd-4801-9416-91fc3908cc8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684354 Jun 21 10:44:21.444918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 356/688] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:44:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:44:21.457008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-24cdb36f-0a58-404a-9809-83943b601ea6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:21.457730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-24cdb36f-0a58-404a-9809-83943b601ea6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:21.522396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-24cdb36f-0a58-404a-9809-83943b601ea6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:21.531873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-24cdb36f-0a58-404a-9809-83943b601ea6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1238 microversion: 2.1 time: 0.079558 Jun 21 10:44:21.532832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 333/689] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:21 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:22.551979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:22.552880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:22.560715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:22.561183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:22.561941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:22.562406 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:22.629478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:22.637615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9794aca5-c70d-4783-88d9-ba2285d0e488 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1290 microversion: 2.1 time: 0.091130 Jun 21 10:44:22.638249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 357/690] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:22 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:23.579405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:23.579951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:23.587209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.587763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.588540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.588973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.614894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lazy-loading 'flavor' on Instance uuid 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:44:23.658990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:23.660219 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:23.669446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.670611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.671886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.672782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.713174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a7bc4c38-ca1d-41fd-9a59-99d78c8cfae4 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "POST /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3/action" status: 202 len: 0 microversion: 2.1 time: 0.137390 Jun 21 10:44:23.713869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 334/691] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:44:23 2022] POST /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:44:23.723552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:23.724715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:23.732604 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.733429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.734435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:23.735393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:23.900761 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:23.910695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-25974d4f-7388-45ac-96a1-cb5c87f4c436 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.256548 Jun 21 10:44:23.911587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 358/692] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:23 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:23.953399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:23.961511 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-63835554-f35b-4015-909f-2554b349eeaa tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.242963 Jun 21 10:44:23.971836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 335/693] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:23 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:24.603758 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5eb13028-d8d6-4061-a836-5b3f87498ba6 req-fa391402-cb54-49ae-99e0-c35ca41616af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3adc6835-6ebb-45b5-a1b4-a0002b38ca69", "tag": "0af20033-2beb-4838-8763-bd647195b000"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:24.621984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5eb13028-d8d6-4061-a836-5b3f87498ba6 req-fa391402-cb54-49ae-99e0-c35ca41616af service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:24.622482 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5eb13028-d8d6-4061-a836-5b3f87498ba6 req-fa391402-cb54-49ae-99e0-c35ca41616af service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:24.637997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5eb13028-d8d6-4061-a836-5b3f87498ba6 req-fa391402-cb54-49ae-99e0-c35ca41616af service nova] Creating event network-changed:0af20033-2beb-4838-8763-bd647195b000 for instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 on hv-cinder-83697 Jun 21 10:44:24.643752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5eb13028-d8d6-4061-a836-5b3f87498ba6 req-fa391402-cb54-49ae-99e0-c35ca41616af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045485 Jun 21 10:44:24.644724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 359/694] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:24.917103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:24.917676 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:24.924975 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:24.925427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:24.926238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:24.927295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:24.929350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:24.930778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:24.937807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:24.938637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:24.939480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:24.940128 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:25.027496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lazy-loading 'services' on Instance uuid f5a140be-30bd-4bd7-9530-9b350be9b8ef {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:44:25.083838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:25.093276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-48798cc2-c598-4595-8b6c-487df9c22e54 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.168509 Jun 21 10:44:25.093914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 360/695] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:24 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:25.099034 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:25.099907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:25.107090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:25.107546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:25.108318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:25.108749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:25.127081 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-17e4555d-cd42-4e93-8f28-807a938a53bf tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments/cbe8ba57-f3be-460c-9aea-bb3690250fb4" status: 202 len: 0 microversion: 2.1 time: 0.214115 Jun 21 10:44:25.130189 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 336/696] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:44:24 2022] DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments/cbe8ba57-f3be-460c-9aea-bb3690250fb4 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:44:25.138969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:25.141295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:25.148365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:25.148903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:25.152000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:25.152582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:25.186616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bde278a7-5de1-44db-883b-1aa9fb36f095 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053004 Jun 21 10:44:25.187304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 337/697] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:25 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:25.265559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:25.276305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c2d550ba-dca7-4914-b06c-486fd7e02136 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.181041 Jun 21 10:44:25.276935 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 361/698] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:25 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:26.110980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:26.111588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:26.118730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.119354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.120161 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.120607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.200297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:26.201232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:26.208359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.209162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.209618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.210080 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.247251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-21df0b55-8fe5-48d2-be22-b4bbbe3156cb tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052051 Jun 21 10:44:26.247831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 362/699] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:26 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:26.277272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:26.292061 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-09efae42-c150-4822-9b08-167b1f3363b8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.184876 Jun 21 10:44:26.292662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 338/700] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:26 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:26.296300 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:26.297532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:26.308525 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.308975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.309821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:26.310381 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:26.450017 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:26.458086 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dce14c7a-b6f9-4514-ad30-55363ee7cbda tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.167816 Jun 21 10:44:26.458673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 363/701] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:26 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:27.263184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:27.264173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:27.270888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.271335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.272140 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.272570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.303019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6c2a2d2c-d7d5-476e-a3bf-bf3038dc507a tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Jun 21 10:44:27.303589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 339/702] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:27 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:27.313069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:27.313652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:27.323244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.324447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.324447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.325161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.473320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:27.477276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:27.477927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:27.482781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-61aae2ab-e055-4b9d-b141-62229c97acc0 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.173733 Jun 21 10:44:27.483473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 364/703] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:27 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:27.484957 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.485417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.486303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:27.486743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:27.650743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:27.659153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-50f408f4-0679-41e9-92c8-d8ca18c92ab8 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.186128 Jun 21 10:44:27.659764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 340/704] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:27 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:28.319338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:28.321114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:28.333646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.334469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.335841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.336678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.378240 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-982ddab1-2499-49eb-a0e4-af058b3a4cda tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065741 Jun 21 10:44:28.379162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 365/705] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:28 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:28.500923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:28.501760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:28.509956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.510605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.511520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.511945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.676538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:28.677523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:28.684223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.684678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.685441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:28.685866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:28.754695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:28.764271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2f94984c-551e-4009-a6fe-5d88fb8bc0a8 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.267316 Jun 21 10:44:28.764868 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 341/706] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:28 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:28.847709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:28.856725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a548277-2f57-473a-98fb-bff04418a730 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.183969 Jun 21 10:44:28.857691 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 366/707] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:28 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:29.391040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:29.392062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:29.398396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.398861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.399924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.400386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.442363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c63e80cd-8c6e-444d-b5fa-02ffaa6b5f8c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055555 Jun 21 10:44:29.442954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 342/708] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:44:29 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:44:29.544196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-bb99331e-717f-4bac-a4eb-c2ebb6b7d9c5 req-f0fcce22-664f-4d8e-8c54-8787874890b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3adc6835-6ebb-45b5-a1b4-a0002b38ca69", "name": "network-vif-plugged", "status": "completed", "tag": "0af20033-2beb-4838-8763-bd647195b000"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:29.544797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:29.545167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:29.555342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.555342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.555342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.555342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.580127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb99331e-717f-4bac-a4eb-c2ebb6b7d9c5 req-f0fcce22-664f-4d8e-8c54-8787874890b3 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.580517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb99331e-717f-4bac-a4eb-c2ebb6b7d9c5 req-f0fcce22-664f-4d8e-8c54-8787874890b3 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.587276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:44:29.595678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-bb99331e-717f-4bac-a4eb-c2ebb6b7d9c5 req-f0fcce22-664f-4d8e-8c54-8787874890b3 service nova] Creating event network-vif-plugged:0af20033-2beb-4838-8763-bd647195b000 for instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 on hv-cinder-83697 Jun 21 10:44:29.600976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-bb99331e-717f-4bac-a4eb-c2ebb6b7d9c5 req-f0fcce22-664f-4d8e-8c54-8787874890b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062901 Jun 21 10:44:29.601926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 367/709] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:29.621639 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:29.698881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5be6217d-45b4-4266-a73b-98ebc913d096 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 204 len: 0 microversion: 2.1 time: 0.158728 Jun 21 10:44:29.700007 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 343/710] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:44:29 2022] DELETE /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:44:29.709360 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:29.710413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:29.717669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.718214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.719054 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.719541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.782778 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:29.783359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:29.790657 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.791180 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.792091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.792570 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.875646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:29.885272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bcf2cd66-a4bc-4556-a149-675264d6b114 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1690 microversion: 2.1 time: 0.180570 Jun 21 10:44:29.885892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 368/711] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:29 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:29.895628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:29.896773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:29.907613 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.908268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.909586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:29.910518 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:29.937314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:29.950558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8623c4e0-d444-48f0-abe9-10e77844c196 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.171768 Jun 21 10:44:29.960329 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 344/712] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:29 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:30.064007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:30.073478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b118ff52-cac3-4528-b18e-63a70587d4ff tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.185018 Jun 21 10:44:30.074150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 369/713] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:29 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:30.903055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:30.903754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:30.910735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:30.911185 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:30.911965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:30.912402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:30.968764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:30.969495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:30.976509 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:30.976947 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:30.977847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:30.978317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:31.001307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:31.083100 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:31.093250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-148d8504-5d46-44b9-979e-59e213b3eb3c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1690 microversion: 2.1 time: 0.194660 Jun 21 10:44:31.093851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 345/714] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:30 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:31.098792 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:31.099701 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:31.111364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:31.112124 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:31.113005 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:31.113435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:31.141112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:31.149189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-05ea16a9-e75a-4e8c-947e-60dd7a63ab6c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.184445 Jun 21 10:44:31.149796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 370/715] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:30 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:31.267424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:31.276986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7ba0cea5-43ad-4d43-a324-686308a5f4a1 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.181880 Jun 21 10:44:31.277561 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 346/716] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:31 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:32.113000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:32.113857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:32.115769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:32.116430 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:32.127570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.128224 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.129178 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.129824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.178450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:32.179581 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:32.183398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:32.194562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.195352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.196821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.197939 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.298759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:32.309495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-403196f8-2bef-4eee-abf3-19d7b03c39e4 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1690 microversion: 2.1 time: 0.200422 Jun 21 10:44:32.310588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 371/717] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:32 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:32.318872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:32.319983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:32.331018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.331545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.332384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:32.332869 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:32.387211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:32.396615 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a607ed6a-1752-43b4-8a4f-e20d35b59c6f tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.225145 Jun 21 10:44:32.397322 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 347/718] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:32 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:32.501265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:32.511034 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec8e2f48-1a7c-409a-8690-0b9a7f086956 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.199002 Jun 21 10:44:32.511863 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 372/719] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:32 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:33.330004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:33.330663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:33.338686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.339395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.341625 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.342368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.416568 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:33.417474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:33.425120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.425564 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.426580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.427018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.619009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:33.627878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8dbc2dcf-1e1f-4480-8eec-c08285fedb77 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1363 microversion: 2.1 time: 0.216910 Jun 21 10:44:33.628213 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 373/720] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:33 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:33.633602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:33.634475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:33.641412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.641861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.642677 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:33.643117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:33.646729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:33.659524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3dcce0d6-e462-48e1-b3f6-e42d8c3576a8 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1690 microversion: 2.1 time: 0.332809 Jun 21 10:44:33.660428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 348/721] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:33 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1690 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:33.803094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:33.816429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-72407e53-3d34-471b-9a98-0a2dc172c612 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.186844 Jun 21 10:44:33.817592 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 374/722] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:33 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:34.475238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-5ebfc238-e198-4a63-b1e1-a0cfa550b1e3 req-fb45501d-64d8-4ded-af57-1cee275ac35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a140be-30bd-4bd7-9530-9b350be9b8ef", "name": "network-vif-deleted", "tag": "6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:34.489620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5ebfc238-e198-4a63-b1e1-a0cfa550b1e3 req-fb45501d-64d8-4ded-af57-1cee275ac35d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.490093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5ebfc238-e198-4a63-b1e1-a0cfa550b1e3 req-fb45501d-64d8-4ded-af57-1cee275ac35d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.507748 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-5ebfc238-e198-4a63-b1e1-a0cfa550b1e3 req-fb45501d-64d8-4ded-af57-1cee275ac35d service nova] Creating event network-vif-deleted:6c4a7abf-a750-4f2c-8a73-1b7c4d5e169f for instance f5a140be-30bd-4bd7-9530-9b350be9b8ef on hv-cinder-83697 Jun 21 10:44:34.514765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-5ebfc238-e198-4a63-b1e1-a0cfa550b1e3 req-fb45501d-64d8-4ded-af57-1cee275ac35d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044626 Jun 21 10:44:34.515511 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 349/723] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:34.649387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:34.650988 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:34.660188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.661265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.662807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.663516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.683307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:34.684464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:34.714647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.715385 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.719460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.730249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.878227 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:34.891671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ea4f2ad6-dbc9-482a-bfc5-fdc420cac76d tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 200 len: 1330 microversion: 2.1 time: 0.215141 Jun 21 10:44:34.898632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:34.899693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 350/724] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:34 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 1330 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:34.905696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eec692fc-0950-41e1-b9da-e67ef42848df tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1549 microversion: 2.1 time: 0.261414 Jun 21 10:44:34.906297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 375/725] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:34 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:34.907504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:34.908149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:34.914410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.916653 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.917685 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.918218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.922977 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:34.923500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:34.929591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.930042 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:34.931432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:34.931875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:35.011700 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2a68f5d6-ed3f-485d-83c1-19e7e9a8d00d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092898 Jun 21 10:44:35.012844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 376/726] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:44:34 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:44:35.502436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:35.510626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-67e09272-f388-4f0f-93c9-9d8a08a7f97a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.608733 Jun 21 10:44:35.511577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 351/727] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:34 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:35.911542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:35.912400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: f5a140be-30bd-4bd7-9530-9b350be9b8ef] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:35.920955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:35.921495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:35.922511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:35.922896 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:35.940842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] HTTP exception thrown: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Request method failure captured: Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef HTTP/1.1 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ7-0Yr6cnHx4a8u5RPb5PC0EvZ74GC7mZPWTXONMJvOammtEaSDl8VP1qqvHkM2oyVwl8AxBELJpWJ-SmV_6gjbbGrpX7otrWYhWKmBBvXupHK_hyPgmxzZ_4rUh_JL7cdJNXoz9vvEF5y5Wc94ht_61JWEMR00EFB3PMhh7fFJpvg Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:44:35.942609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ddb0def61dd452db3588952af149fb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ddb0def61dd452db3588952af149fb7"}]}] Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 9bbb5d4487874bdd9f82e28651a418f9 Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. Jun 21 10:44:35.944397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'f5a140be-30bd-4bd7-9530-9b350be9b8ef'} Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:44:35.945541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. Jun 21 10:44:35.947074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:44:35.948597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Returning 404 to user: Instance f5a140be-30bd-4bd7-9530-9b350be9b8ef could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:44:35.948597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5dd5805b-1b33-49fe-8856-7478c21c7033 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef" status: 404 len: 111 microversion: 2.1 time: 0.038323 Jun 21 10:44:35.948597 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 377/728] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:35 2022] GET /compute/v2.1/servers/f5a140be-30bd-4bd7-9530-9b350be9b8ef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:44:35.954278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ea42364b-fde2-4491-9d69-1f4e5f9025ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '.version_select at 0x7f8a3656ef70>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:35.975485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ea42364b-fde2-4491-9d69-1f4e5f9025ae tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936798644" status: 202 len: 0 microversion: 2.1 time: 0.025007 Jun 21 10:44:35.976273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 352/729] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 21 10:44:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936798644 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:44:36.532731 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:36.533841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:36.551334 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:36.552214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:36.554157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:36.555204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:36.735902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-491fe90b-e1c5-4287-9454-57a7dd61c647 req-efbd76df-1e3d-4a28-96b9-f0d3cf7f8182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3adc6835-6ebb-45b5-a1b4-a0002b38ca69", "tag": "0af20033-2beb-4838-8763-bd647195b000"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:36.750364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-491fe90b-e1c5-4287-9454-57a7dd61c647 req-efbd76df-1e3d-4a28-96b9-f0d3cf7f8182 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:36.750800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-491fe90b-e1c5-4287-9454-57a7dd61c647 req-efbd76df-1e3d-4a28-96b9-f0d3cf7f8182 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:36.763437 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-491fe90b-e1c5-4287-9454-57a7dd61c647 req-efbd76df-1e3d-4a28-96b9-f0d3cf7f8182 service nova] Creating event network-changed:0af20033-2beb-4838-8763-bd647195b000 for instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 on hv-cinder-83697 Jun 21 10:44:36.768584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-491fe90b-e1c5-4287-9454-57a7dd61c647 req-efbd76df-1e3d-4a28-96b9-f0d3cf7f8182 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037333 Jun 21 10:44:36.769520 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 353/730] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:36.837912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:36.845675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3ccd43aa-27a3-4c5e-ba0e-f3fb3eddcadb tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.319954 Jun 21 10:44:36.846262 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 378/731] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:36 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:37.864288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:37.864990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:37.873177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:37.873836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:37.874832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:37.875425 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:38.129461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:38.138829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2268f2d5-c447-4a0b-9e7f-67191f572d46 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.278356 Jun 21 10:44:38.146474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 354/732] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:37 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:39.133290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:39.133853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:39.140880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.141331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.142126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.142562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.156361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:39.156997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:39.163845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.164285 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.165097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.165469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.169405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:44:39.256246 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2b759613-aa63-4f08-8a3e-a2828e2bfe54 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 204 len: 0 microversion: 2.1 time: 0.126471 Jun 21 10:44:39.257334 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 379/733] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:44:39 2022] DELETE /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:44:39.267125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:39.267836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:39.274134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.274521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.275406 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.275920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.310369 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:39.318302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a2e77535-01e6-4e55-9133-61d9de4c67b0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1509 microversion: 2.1 time: 0.165714 Jun 21 10:44:39.318883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 355/734] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:39 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:39.335037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:39.335692 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:39.342123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.342657 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.343494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.343998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.417181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:39.434892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d629a6de-aa23-4a4a-aeb5-88080a82e485 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1507 microversion: 2.1 time: 0.172238 Jun 21 10:44:39.435776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 380/735] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:39 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:39.446869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d47b7811-fb4b-4d63-ac1d-d8bc2d3219c0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "POST /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3/action" status: 202 len: 0 microversion: 2.1 time: 0.115770 Jun 21 10:44:39.448044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 356/736] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:44:39 2022] POST /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:44:39.456083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:39.456722 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:39.463739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.464179 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.465200 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:39.465586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:39.645462 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:39.654029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3bf3f6e8-b497-4766-9324-aae22c2d5c67 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1517 microversion: 2.1 time: 0.201814 Jun 21 10:44:39.654651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 381/737] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:39 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:40.453204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:40.454834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:40.464085 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:40.464530 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:40.465641 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:40.465953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:40.572610 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:40.584847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-77531f8f-e056-4529-8f51-25559db9b1c5 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 200 len: 1465 microversion: 2.1 time: 0.136078 Jun 21 10:44:40.586157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-aa2d2ab6-fd89-414a-8ca9-eba06abef5eb req-a286f5f6-5d16-4e15-a61a-9e863b721184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59895c2d-27a0-4bbb-8fad-a6512041d87f", "name": "network-vif-deleted", "tag": "b79d70d7-f715-4336-a3e6-dcaf0e33ceb0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:40.586760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 357/738] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:40 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 1465 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:40.601187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-aa2d2ab6-fd89-414a-8ca9-eba06abef5eb req-a286f5f6-5d16-4e15-a61a-9e863b721184 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:40.603218 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-aa2d2ab6-fd89-414a-8ca9-eba06abef5eb req-a286f5f6-5d16-4e15-a61a-9e863b721184 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:40.620646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-aa2d2ab6-fd89-414a-8ca9-eba06abef5eb req-a286f5f6-5d16-4e15-a61a-9e863b721184 service nova] Creating event network-vif-deleted:b79d70d7-f715-4336-a3e6-dcaf0e33ceb0 for instance 59895c2d-27a0-4bbb-8fad-a6512041d87f on hv-cinder-83697 Jun 21 10:44:40.628343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-aa2d2ab6-fd89-414a-8ca9-eba06abef5eb req-a286f5f6-5d16-4e15-a61a-9e863b721184 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052002 Jun 21 10:44:40.628940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 382/739] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:40.671933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:40.672739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:40.679838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:40.680790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:40.681631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:40.682303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:40.851679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:40.861160 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ef0fe073-342c-4307-bcde-bebc6d22b15a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1519 microversion: 2.1 time: 0.193844 Jun 21 10:44:40.861874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 358/740] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:40 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:41.516151 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-fe5e796f-0773-4668-9d27-c6fe4f10cf54 req-9b91f757-c09e-4ba9-977e-2737a6fa0076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:41.526693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-fe5e796f-0773-4668-9d27-c6fe4f10cf54 req-9b91f757-c09e-4ba9-977e-2737a6fa0076 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.527466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-fe5e796f-0773-4668-9d27-c6fe4f10cf54 req-9b91f757-c09e-4ba9-977e-2737a6fa0076 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.542727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.compute.server_external_events [req-fe5e796f-0773-4668-9d27-c6fe4f10cf54 req-9b91f757-c09e-4ba9-977e-2737a6fa0076 service nova] Unable to find a host for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3. Dropping event network-vif-unplugged {{(pid=124179) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 10:44:41.543170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-fe5e796f-0773-4668-9d27-c6fe4f10cf54 req-9b91f757-c09e-4ba9-977e-2737a6fa0076 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032958 Jun 21 10:44:41.544294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 383/741] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 21 10:44:41.603474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:41.604190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: 59895c2d-27a0-4bbb-8fad-a6512041d87f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:41.611707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.612126 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.612893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.613321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.627240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] HTTP exception thrown: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Request method failure captured: Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f HTTP/1.1 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ7-0Yr6cnHx4a8u5RPb5PC0EvZ74GC7mZPWTXONMJvOammtEaSDl8VP1qqvHkM2oyVwl8AxBELJpWJ-SmV_6gjbbGrpX7otrWYhWKmBBvXupHK_hyPgmxzZ_4rUh_JL7cdJNXoz9vvEF5y5Wc94ht_61JWEMR00EFB3PMhh7fFJpvg Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:44:41.628921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ddb0def61dd452db3588952af149fb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ddb0def61dd452db3588952af149fb7"}]}] Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 9bbb5d4487874bdd9f82e28651a418f9 Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. Jun 21 10:44:41.630547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '59895c2d-27a0-4bbb-8fad-a6512041d87f'} Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:44:41.631358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. Jun 21 10:44:41.632809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:41.634196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Returning 404 to user: Instance 59895c2d-27a0-4bbb-8fad-a6512041d87f could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:44:41.634196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-741d2ccf-e536-42c7-957a-bdedfb56b014 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jun 21 10:44:41.634196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 359/742] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:41 2022] GET /compute/v2.1/servers/59895c2d-27a0-4bbb-8fad-a6512041d87f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:44:41.639628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:41.640241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:41.647757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.648265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.649028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.649457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.675378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:44:41.747317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:41.761497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4d1cd96a-111d-413d-a19c-592610ef340e tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 204 len: 0 microversion: 2.1 time: 0.125911 Jun 21 10:44:41.762180 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 384/743] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:44:41 2022] DELETE /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:44:41.771529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:41.772141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:41.778877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.779318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.780085 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.780528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.880329 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:41.881127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:41.888870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.889468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.890570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:41.891006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:41.942673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:41.952053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5f893846-60b0-49da-8f59-5c3c46b16450 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.184758 Jun 21 10:44:41.952683 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 360/744] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:41 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:42.057718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:42.074079 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-820323e6-dc60-4896-bd57-1bb36fe32f5d tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.198223 Jun 21 10:44:42.074719 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 385/745] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:41 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:42.970153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:42.971170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:42.980411 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:42.980894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:42.981873 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:42.982405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:43.004514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:43.099339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:43.100519 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:43.108059 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:43.108664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:43.109455 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:43.109894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:43.114250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:43.254669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:43.264795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-198c0a3a-517a-414c-8571-59b38df7aa11 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.169433 Jun 21 10:44:43.265349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 386/746] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:43 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:43.267500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:43.279233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0cafb1c0-fb58-4c6d-acdc-f1ecfc562fcc tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1521 microversion: 2.1 time: 0.313451 Jun 21 10:44:43.279916 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 361/747] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:42 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:43.585320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8392fcfa-8b7e-4b07-80cc-03d7bdcf7191 req-e0882d93-0546-493b-b548-a521d7b25f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6ee216-79c8-4e70-b987-7cab0f5c5dd7", "name": "network-vif-unplugged", "status": "completed", "tag": "14c5f777-8428-430b-a5a7-e316b6105b4b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:43.594585 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8392fcfa-8b7e-4b07-80cc-03d7bdcf7191 req-e0882d93-0546-493b-b548-a521d7b25f6b service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:43.595103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8392fcfa-8b7e-4b07-80cc-03d7bdcf7191 req-e0882d93-0546-493b-b548-a521d7b25f6b service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:43.608102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8392fcfa-8b7e-4b07-80cc-03d7bdcf7191 req-e0882d93-0546-493b-b548-a521d7b25f6b service nova] Creating event network-vif-unplugged:14c5f777-8428-430b-a5a7-e316b6105b4b for instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 on hv-cinder-83697 Jun 21 10:44:43.615346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8392fcfa-8b7e-4b07-80cc-03d7bdcf7191 req-e0882d93-0546-493b-b548-a521d7b25f6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032933 Jun 21 10:44:43.615816 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 387/748] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:44.073945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-907d592d-3e97-48d1-bb19-582f24d3303f req-09d6394d-a3ec-4a32-b86a-462b0ecf8370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6ee216-79c8-4e70-b987-7cab0f5c5dd7", "name": "network-vif-deleted", "tag": "14c5f777-8428-430b-a5a7-e316b6105b4b"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:44.083452 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-907d592d-3e97-48d1-bb19-582f24d3303f req-09d6394d-a3ec-4a32-b86a-462b0ecf8370 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:44.083891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-907d592d-3e97-48d1-bb19-582f24d3303f req-09d6394d-a3ec-4a32-b86a-462b0ecf8370 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:44.095666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-907d592d-3e97-48d1-bb19-582f24d3303f req-09d6394d-a3ec-4a32-b86a-462b0ecf8370 service nova] Creating event network-vif-deleted:14c5f777-8428-430b-a5a7-e316b6105b4b for instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 on hv-cinder-83697 Jun 21 10:44:44.100864 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-907d592d-3e97-48d1-bb19-582f24d3303f req-09d6394d-a3ec-4a32-b86a-462b0ecf8370 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Jun 21 10:44:44.101447 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 362/749] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:44:44.296171 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:44.296861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:44.304515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:44.304866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:44.305661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:44.306104 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:44.373952 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:44.382477 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-acb2c807-1c2b-46b4-98b9-7ac982a05b9c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1479 microversion: 2.1 time: 0.090265 Jun 21 10:44:44.383077 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 363/750] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:44 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1479 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:44.406618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:44.407404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:44.414157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:44.414603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:44.415382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:44.415835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:44.566133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:44.575705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7bde3278-bcbb-4407-9eb9-7c97b0921509 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.296120 Jun 21 10:44:44.576567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 388/751] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:44 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:45.402837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:45.403475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:45.407618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:45.416246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:45.417030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:45.418475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:45.419269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:45.459265 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:45.459712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:45.460164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lazy-loading 'fault' on Instance uuid fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:44:45.516612 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbb5d4487874bdd9f82e28651a418f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddb0def61dd452db3588952af149fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:45.527034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-01d13879-20ac-46cb-a019-e5448aaccd36 tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 200 len: 1311 microversion: 2.1 time: 0.129666 Jun 21 10:44:45.528137 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 364/752] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:45 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:45.597205 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:45.597850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:45.604775 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:45.605196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:45.606105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:45.606551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:45.756294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:45.765643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a7ca56f1-8e07-45b6-a208-680aae45655b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.172375 Jun 21 10:44:45.766235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 389/753] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:45 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:46.553880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:46.554514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] [instance: fb6ee216-79c8-4e70-b987-7cab0f5c5dd7] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:46.562393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:46.562843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:46.563633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:46.564068 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:46.579261 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] HTTP exception thrown: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Request method failure captured: Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 HTTP/1.1 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ7-0Yr6cnHx4a8u5RPb5PC0EvZ74GC7mZPWTXONMJvOammtEaSDl8VP1qqvHkM2oyVwl8AxBELJpWJ-SmV_6gjbbGrpX7otrWYhWKmBBvXupHK_hyPgmxzZ_4rUh_JL7cdJNXoz9vvEF5y5Wc94ht_61JWEMR00EFB3PMhh7fFJpvg Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:44:46.580986 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3ddb0def61dd452db3588952af149fb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3ddb0def61dd452db3588952af149fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3ddb0def61dd452db3588952af149fb7"}]}] Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 3ddb0def61dd452db3588952af149fb7 Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472965566 Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 9bbb5d4487874bdd9f82e28651a418f9 Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472965566-project Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. Jun 21 10:44:46.583509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'fb6ee216-79c8-4e70-b987-7cab0f5c5dd7'} Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:44:46.585170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. Jun 21 10:44:46.587926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:44:46.590014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] Returning 404 to user: Instance fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:44:46.590014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-92efb276-e417-42a3-812f-12ada5f23f1c tempest-ServerRescueNegativeTestJSON-1472965566 tempest-ServerRescueNegativeTestJSON-1472965566-project] 10.222.0.43 "GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7" status: 404 len: 111 microversion: 2.1 time: 0.032539 Jun 21 10:44:46.590014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 365/754] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:46 2022] GET /compute/v2.1/servers/fb6ee216-79c8-4e70-b987-7cab0f5c5dd7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:44:46.790564 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:46.791393 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:46.799543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:46.800010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:46.800933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:46.801417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:47.038156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:47.047043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b634cfdc-77db-41ce-9452-260e8d6b29be tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.261669 Jun 21 10:44:47.047681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 390/755] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:46 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:48.067880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:48.068845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:48.077842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:48.078359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:48.079136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:48.079571 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:48.228717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:48.237041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1a62c11a-a8eb-4f9b-a0dd-49154ee74fc0 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.175792 Jun 21 10:44:48.237888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 366/756] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:48 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:49.255035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:49.255694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:49.262760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:49.263211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:49.263994 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:49.264405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:49.471511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:49.479517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5caa2257-a45d-417f-be11-ab3070a5c527 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.228435 Jun 21 10:44:49.480089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 391/757] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:49 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:50.499725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:50.500341 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:50.507009 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:50.507448 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:50.508211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:50.508642 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:50.650205 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:50.658737 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-84c94e76-89a2-4c97-ab68-2c4f12cca863 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.166114 Jun 21 10:44:50.659357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 367/758] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:50 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:51.678396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:51.679059 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:51.690846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:51.691621 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:51.692994 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:51.693933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:51.902453 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:51.911227 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a99c5c26-135d-49ba-8c7c-f0e2624f659b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.238029 Jun 21 10:44:51.912589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 392/759] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:51 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:44:52.933813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:52.935918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:52.957324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:52.957908 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:52.958764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:52.959279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:53.128314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:53.137239 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0dd4cbf5-d059-4bfd-b592-8fcad1b4f59e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.211662 Jun 21 10:44:53.137815 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 368/760] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:52 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:54.156139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:54.156686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:54.164015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:54.164746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:54.165483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:54.166147 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:54.324802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:54.333257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e4ffde44-b9ad-435c-943b-e6704c20f129 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.182165 Jun 21 10:44:54.334563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 393/761] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:54 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:55.351276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:55.351924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:55.359181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:55.368408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:55.368408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:55.368408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:55.595903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:55.605833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3cb2c372-6a9d-4fb3-ba7d-dafbc37c6ac5 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.258297 Jun 21 10:44:55.616460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 369/762] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:55 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:55.983337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-87277f68-02a8-49f1-8b66-5271acb5318f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: .version_select at 0x7f8a35d898b0>, body: {"keypair": {"name": "tempest-keypair-1377941506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5BVCP6mgXZjIkvgDCH4yA9EnpxrVM0P8e4uTXJFJYSiGzk0Emhwlfam0y011en5Hod8Z1heYCISGcx5UBBkMfWhKGq5tL1AG4ro6SOXgtCQ+jPsVixmelX49FRqEO5ng=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:56.007724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-87277f68-02a8-49f1-8b66-5271acb5318f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for project 136181b906064188b6d06ca200fb9037. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:44:56.013370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-87277f68-02a8-49f1-8b66-5271acb5318f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for user 6a75b9c7a5bc4959b27d5c5b87b9c1cd and project 136181b906064188b6d06ca200fb9037. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:44:56.045949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-87277f68-02a8-49f1-8b66-5271acb5318f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186600 Jun 21 10:44:56.046607 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 394/763] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jun 21 10:44:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 10:44:56.145183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-1fa7b34d-a3f9-40c9-b18a-4113968274d5 req-ab00d5bc-f343-449c-9d12-059e4cdc3ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "name": "network-vif-plugged", "status": "completed", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:56.166670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1fa7b34d-a3f9-40c9-b18a-4113968274d5 req-ab00d5bc-f343-449c-9d12-059e4cdc3ff9 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:56.167537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1fa7b34d-a3f9-40c9-b18a-4113968274d5 req-ab00d5bc-f343-449c-9d12-059e4cdc3ff9 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:56.195228 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-1fa7b34d-a3f9-40c9-b18a-4113968274d5 req-ab00d5bc-f343-449c-9d12-059e4cdc3ff9 service nova] Creating event network-vif-plugged:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:44:56.201538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-1fa7b34d-a3f9-40c9-b18a-4113968274d5 req-ab00d5bc-f343-449c-9d12-059e4cdc3ff9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060575 Jun 21 10:44:56.204429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 370/764] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:44:56.624427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:56.625270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:56.632350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:56.632790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:56.633560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:56.634190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:57.088218 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:57.097763 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-87d5ba9e-df9e-4880-884d-7d565bf57520 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1575 microversion: 2.1 time: 0.478506 Jun 21 10:44:57.098713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 395/765] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:56 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1575 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:57.852572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-61262844", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0b5a4d-9565-4660-b0b8-572ddf3eb6ed"}], "security_groups": [{"name": "tempest-securitygroup--1749427620"}], "key_name": "tempest-keypair-1377941506", "user_data": "}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:44:57.970980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] validate_networks() for [('8b0b5a4d-9565-4660-b0b8-572ddf3eb6ed', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:44:58.115688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:58.116295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:58.124655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:58.125205 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:58.126426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:58.127092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:58.306999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:58.316836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e5a0d60a-17ff-4be3-9d10-118c94ece347 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1562 microversion: 2.1 time: 0.205125 Jun 21 10:44:58.317424 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 396/766] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:44:58 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1562 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:44:58.418111 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:44:58.418973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:44:58.420107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:44:58.420852 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:44:58.421635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:44:58.445073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:58.446563 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:58.448819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:58.449902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:58.480500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for project 136181b906064188b6d06ca200fb9037. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:44:58.493496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for user 6a75b9c7a5bc4959b27d5c5b87b9c1cd and project 136181b906064188b6d06ca200fb9037. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:44:58.511283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:44:58.514358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:44:58.563504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-28baf98c-ac37-454d-bdb9-9737fa3400ab tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.717360 Jun 21 10:44:58.564274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 371/767] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Jun 21 10:44:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 10:44:58.577708 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:58.578702 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:58.663252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:58.672506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:58.673967 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:58.675276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-79b70cfc-e7c4-43e0-ba1f-3ffa41c59e45 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1280 microversion: 2.20 time: 0.102104 Jun 21 10:44:58.675826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 397/768] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:44:58 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:44:59.694480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:44:59.695107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:44:59.716673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:59.717148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:59.717931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:44:59.718398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:44:59.809517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:59.821344 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:59.824107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:44:59.825515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-34e3ce5a-1376-4666-b286-4ac9208c3859 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1340 microversion: 2.20 time: 0.135195 Jun 21 10:44:59.837414 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 372/769] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:44:59 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1340 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:00.845837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:00.846817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:00.855995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:00.856534 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:00.857401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:00.857887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:00.992386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:01.000822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:01.002259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:01.003387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-daa26b08-6abd-4757-a9a4-de47706b827b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.162512 Jun 21 10:45:01.003956 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 398/770] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:00 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:01.363822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-701c95d5-c319-4ed2-b2c1-c8df31f8c1b5 req-6a760ba6-81c6-4682-9d3c-2f721e72b159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:01.380775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-701c95d5-c319-4ed2-b2c1-c8df31f8c1b5 req-6a760ba6-81c6-4682-9d3c-2f721e72b159 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:01.381465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-701c95d5-c319-4ed2-b2c1-c8df31f8c1b5 req-6a760ba6-81c6-4682-9d3c-2f721e72b159 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:01.401590 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-701c95d5-c319-4ed2-b2c1-c8df31f8c1b5 req-6a760ba6-81c6-4682-9d3c-2f721e72b159 service nova] Creating event network-changed:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:45:01.407153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-701c95d5-c319-4ed2-b2c1-c8df31f8c1b5 req-6a760ba6-81c6-4682-9d3c-2f721e72b159 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054209 Jun 21 10:45:01.407777 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 373/771] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:45:02.022324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:02.023070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:02.030994 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:02.031458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:02.032242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:02.032681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:02.173003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:02.182341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:02.185000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:02.186078 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bfb27c3e-2c9b-47de-8ad1-c0166993d230 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.167806 Jun 21 10:45:02.186745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 399/772] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:02 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:03.209751 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:03.210693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:03.219389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:03.219886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:03.220644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:03.221080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:03.377834 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:03.391051 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:03.392771 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:03.394354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a8cbf6df-6e16-44f5-9221-bb5b2476d1ae tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.191422 Jun 21 10:45:03.395023 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 374/773] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:03 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:04.414836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:04.415673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:04.424339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:04.424782 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:04.425549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:04.425974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:04.563764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:04.577112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:04.579440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:04.581088 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0057b9bd-5825-4b29-b43b-46ca8562164d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.170814 Jun 21 10:45:04.582075 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 400/774] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:04 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:05.603160 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:05.603844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:05.611158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:05.611608 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:05.612381 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:05.612818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:05.776599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:05.785232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:05.786760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:05.787866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e4913489-e6ad-42b6-90ea-35b37cc88c65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.188672 Jun 21 10:45:05.788399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 375/775] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:05 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:06.806866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:06.807468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:06.814725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:06.815179 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:06.815962 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:06.816400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:06.962350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:06.972523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:06.974012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:06.975189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-00910e28-f824-4191-845f-bf5f5aed8941 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.172306 Jun 21 10:45:06.975763 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 401/776] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:06 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:07.994453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:07.995320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:08.002939 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:08.003392 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:08.004188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:08.004627 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:08.046521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-1ec707eb-371e-4311-8fe9-5390b009ecaa req-c576584f-0ed6-4f9f-bf81-2ba297fbc928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "name": "network-vif-plugged", "status": "completed", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:08.056887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-1ec707eb-371e-4311-8fe9-5390b009ecaa req-c576584f-0ed6-4f9f-bf81-2ba297fbc928 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:08.057281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-1ec707eb-371e-4311-8fe9-5390b009ecaa req-c576584f-0ed6-4f9f-bf81-2ba297fbc928 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:08.073196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-1ec707eb-371e-4311-8fe9-5390b009ecaa req-c576584f-0ed6-4f9f-bf81-2ba297fbc928 service nova] Creating event network-vif-plugged:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:45:08.078713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-1ec707eb-371e-4311-8fe9-5390b009ecaa req-c576584f-0ed6-4f9f-bf81-2ba297fbc928 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Jun 21 10:45:08.080291 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 402/777] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:45:08.179505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:08.188806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:08.190361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:08.191521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8b31d1b9-4db0-4ae7-bf97-108ba4467af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.201152 Jun 21 10:45:08.192091 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 376/778] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:07 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:09.211069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:09.211692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:09.213718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:09.220810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:09.221269 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:09.222090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:09.222533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:09.376508 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:09.386936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:09.388433 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:09.389551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6be070f8-4385-4f6f-9432-fc02d2a5a8bf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1406 microversion: 2.20 time: 0.182997 Jun 21 10:45:09.390123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 403/779] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:09 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:10.409121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:10.409739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:10.411798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:10.412453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:10.419793 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:10.420218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:10.420985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:10.421405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:10.571647 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:10.580822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:10.582393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:10.583637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-16794403-76e2-4f76-92b6-adcc84e18952 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1597 microversion: 2.20 time: 0.179348 Jun 21 10:45:10.584183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 377/780] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:45:10 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:45:10.602805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:10.603404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:10.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:10.611069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:10.611856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:10.612284 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:10.698610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4aee64da-b786-4470-bbca-7431773ecad1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099757 Jun 21 10:45:10.699589 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 404/781] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Jun 21 10:45:10 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:45:11.754830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-4f86eeb4-0f2f-4b09-a606-2e38a851e748 req-d1a84988-41e8-49cb-94f2-e26c443011f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:11.768243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-4f86eeb4-0f2f-4b09-a606-2e38a851e748 req-d1a84988-41e8-49cb-94f2-e26c443011f6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:11.768956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-4f86eeb4-0f2f-4b09-a606-2e38a851e748 req-d1a84988-41e8-49cb-94f2-e26c443011f6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:11.787794 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-4f86eeb4-0f2f-4b09-a606-2e38a851e748 req-d1a84988-41e8-49cb-94f2-e26c443011f6 service nova] Creating event network-changed:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:45:11.795395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-4f86eeb4-0f2f-4b09-a606-2e38a851e748 req-d1a84988-41e8-49cb-94f2-e26c443011f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046801 Jun 21 10:45:11.796110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 378/782] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:45:22.635403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:22.636703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=90 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:22.641203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:22.642465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:22.651435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:22.651912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:22.652695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:22.653131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:22.683100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:45:22.783330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-61a94dda-83c3-48de-8681-2cecb0dbc966 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "DELETE /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 204 len: 0 microversion: 2.1 time: 0.149027 Jun 21 10:45:22.784440 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 405/783] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:45:22 2022] DELETE /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:45:22.794408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:22.795653 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=82 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:22.803631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:22.804973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:22.818707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:22.819503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:22.820947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:22.821713 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:23.030379 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:23.038481 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6ebf1ce5-a85e-4856-8af5-168cf88ca9c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1574 microversion: 2.1 time: 0.247104 Jun 21 10:45:23.039080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 379/784] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:22 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:24.066675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:24.067584 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:24.075627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:24.076126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:24.077113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:24.077590 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:24.255153 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:24.263502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b2da1a8e-8ff2-4f72-b594-9acd859b6b83 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1574 microversion: 2.1 time: 0.203335 Jun 21 10:45:24.264093 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 406/785] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:24 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:25.283066 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:25.283973 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:25.291420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:25.291858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:25.292666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:25.293118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:25.646203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:25.654996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-492e03a4-7cef-4918-94b9-aafedc8618aa tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1574 microversion: 2.1 time: 0.376329 Jun 21 10:45:25.656386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 380/786] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:25 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1574 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:26.164872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-f776afe7-d26a-4a99-9118-ab4980412f10 req-6bd37b66-bc46-4f3c-bb13-c57827f6139a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b3df2f-73ff-43d7-b18e-76d349dd118d", "name": "network-vif-deleted", "tag": "dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:26.179554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f776afe7-d26a-4a99-9118-ab4980412f10 req-6bd37b66-bc46-4f3c-bb13-c57827f6139a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:26.180170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f776afe7-d26a-4a99-9118-ab4980412f10 req-6bd37b66-bc46-4f3c-bb13-c57827f6139a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:26.195194 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-f776afe7-d26a-4a99-9118-ab4980412f10 req-6bd37b66-bc46-4f3c-bb13-c57827f6139a service nova] Creating event network-vif-deleted:dc9f868b-d59e-4fd7-acfb-9f75de7a4ddd for instance 18b3df2f-73ff-43d7-b18e-76d349dd118d on hv-cinder-83697 Jun 21 10:45:26.202769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-f776afe7-d26a-4a99-9118-ab4980412f10 req-6bd37b66-bc46-4f3c-bb13-c57827f6139a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041569 Jun 21 10:45:26.203808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 407/787] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:45:26.688097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:26.689310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:26.700423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:26.701523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:26.703374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:26.704470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:26.754675 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:26.755249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:26.755806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lazy-loading 'fault' on Instance uuid 18b3df2f-73ff-43d7-b18e-76d349dd118d {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:45:26.811775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:26.822875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-43c62023-c62c-48bd-b1ed-7bd3fcc2ce69 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 200 len: 1229 microversion: 2.1 time: 0.143343 Jun 21 10:45:26.823804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 381/788] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:26 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 1229 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:27.845710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:27.846401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:27.855074 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:27.855536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:27.856369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:27.856807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:27.872161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] HTTP exception thrown: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Request method failure captured: Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d HTTP/1.1 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaB1fT-AsVPhNJvc2vSKzBTMIifumBGAJsvIg45T9_6V9U4wznZycoZwoxv46QwhxO_buRLnGK875aOWfzX-VBGeEdPKc36gdi_8toRkQlWFpe2Gi4qrQwAUnhzL1BJjPALj8qGIrRsRnOrdpqU2J7tGOiRmdCx_eN0OV03P0xObht8 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:45:27.873944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25adacdcc5b44375b112a93f8623802c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25adacdcc5b44375b112a93f8623802c"}]}] Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f9eaebabd54a45a29f262b67fe1c433b Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:45:27.876505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '18b3df2f-73ff-43d7-b18e-76d349dd118d'} Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:45:27.877874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:45:27.880057 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:45:27.882083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Returning 404 to user: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:45:27.882083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e7b11997-d661-47a4-b918-a834433566a9 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 404 len: 111 microversion: 2.1 time: 0.034698 Jun 21 10:45:27.882083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 408/789] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:27 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:45:28.000730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1725871040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-396547085", "security_groups": [{"name": "tempest-secgroup-smoke-21708833"}], "block_device_mapping_v2": [{"uuid": "80f03169-9bc9-4312-baaa-39ce6fc98ade", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "093916b0-2043-4c85-8617-0988f1b9e421"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:28.125840 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] validate_networks() for [('093916b0-2043-4c85-8617-0988f1b9e421', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:45:28.583847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:45:28.584269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:45:28.584748 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:45:28.585156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:45:28.585787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:45:28.597499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:28.597953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:28.598830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:28.599273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:28.619458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:45:28.624422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for user f9eaebabd54a45a29f262b67fe1c433b and project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:45:28.699404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:45:28.701569 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80f03169-9bc9-4312-baaa-39ce6fc98ade',volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:45:28.861166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-831cb432-67ba-4654-b78e-4cbc389d1844 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.864526 Jun 21 10:45:28.861819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 382/790] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:45:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:45:28.884087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fa7ad5ef-5793-4857-a333-d0d94f274e92 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:28.885077 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fa7ad5ef-5793-4857-a333-d0d94f274e92 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:28.971908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fa7ad5ef-5793-4857-a333-d0d94f274e92 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:28.985076 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fa7ad5ef-5793-4857-a333-d0d94f274e92 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1094 microversion: 2.1 time: 0.116420 Jun 21 10:45:28.986993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 409/791] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:28 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:30.012176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:30.013302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:30.024822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:30.025620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:30.027028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:30.027864 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:30.190761 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:30.201376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a054152b-fd0b-486c-a48f-d9e30452a6ec tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1200 microversion: 2.1 time: 0.197297 Jun 21 10:45:30.202312 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 383/792] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:30 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1200 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:31.225604 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:31.226511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:31.235684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:31.236344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:31.237166 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:31.237610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:31.483964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:31.493517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-45f5e786-0f61-4a67-8dac-89daf92ff175 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.271970 Jun 21 10:45:31.494137 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 410/793] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:31 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:31.819883 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-14352075-3915-4c7b-b830-2e3950cbfa1e req-24b701f3-1df6-4e0b-bc6b-428bd62d38bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d58729-e3ad-4fab-9951-142b1802143b", "tag": "b783232c-084d-414d-9238-01324a0ba7cb"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:31.850809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-14352075-3915-4c7b-b830-2e3950cbfa1e req-24b701f3-1df6-4e0b-bc6b-428bd62d38bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:31.852445 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-14352075-3915-4c7b-b830-2e3950cbfa1e req-24b701f3-1df6-4e0b-bc6b-428bd62d38bf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:31.886275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-14352075-3915-4c7b-b830-2e3950cbfa1e req-24b701f3-1df6-4e0b-bc6b-428bd62d38bf service nova] Creating event network-changed:b783232c-084d-414d-9238-01324a0ba7cb for instance 08d58729-e3ad-4fab-9951-142b1802143b on hv-cinder-83697 Jun 21 10:45:31.895063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-14352075-3915-4c7b-b830-2e3950cbfa1e req-24b701f3-1df6-4e0b-bc6b-428bd62d38bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093356 Jun 21 10:45:31.896194 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 384/794] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:45:32.513654 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:32.514398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:32.522546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:32.522992 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:32.523776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:32.524201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:32.702504 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:32.711653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-67e6161f-ab6e-49e0-a4ee-31f5be5aaf59 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.202397 Jun 21 10:45:32.712223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 411/795] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:32 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:33.731779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:33.732788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:33.751886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:33.752474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:33.753455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:33.753889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:34.107283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:34.117870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ce0b2d77-d99c-4bc7-9523-54ad4abfdbdb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.391602 Jun 21 10:45:34.118633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 385/796] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:33 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:35.137414 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:35.138162 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:35.146174 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:35.146634 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:35.147424 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:35.147864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:35.321615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:35.330532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9091442c-b110-4888-aca3-3e1a3c4950c6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.197186 Jun 21 10:45:35.331146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 412/797] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:35 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:36.348385 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:36.349150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:36.356500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:36.356929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:36.357760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:36.358222 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:36.536303 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:36.544747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fcb0de5e-2346-41f0-9b37-bbb18d9792fe tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.200747 Jun 21 10:45:36.545358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 386/798] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:36 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:37.569102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:37.569796 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:37.577725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:37.578224 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:37.579547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:37.579980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:37.749250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:37.758117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a5912a28-d255-4c85-8277-c0948272800a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.193351 Jun 21 10:45:37.758746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 413/799] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:37 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:38.777170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:38.777800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:38.780600 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:38.781262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:38.788812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:38.789278 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:38.790079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:38.790509 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:38.932295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:38.940412 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1818725d-c29c-4991-b842-07cdad8d6f8d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.168743 Jun 21 10:45:38.940965 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 387/800] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:38 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:39.967372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:39.968511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:39.972957 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:39.980852 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:39.981287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:39.982119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:39.982572 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:40.138272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:40.146765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9314250a-1504-424d-8d67-4eaf3558171c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.186432 Jun 21 10:45:40.147545 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 414/801] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:39 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:41.166149 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:41.166769 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:41.174734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:41.175177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:41.175921 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:41.176372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:41.324547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:41.332670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-165c9dc2-9c44-428f-be30-1799912baddb tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.170415 Jun 21 10:45:41.333250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 388/802] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:41 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:42.177496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-d9adf32f-4240-4822-ad00-db1aca037a90 req-6b355e1c-4223-4b8c-9116-b246f0be38c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d58729-e3ad-4fab-9951-142b1802143b", "name": "network-vif-plugged", "status": "completed", "tag": "b783232c-084d-414d-9238-01324a0ba7cb"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:42.186366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-d9adf32f-4240-4822-ad00-db1aca037a90 req-6b355e1c-4223-4b8c-9116-b246f0be38c3 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:42.187038 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-d9adf32f-4240-4822-ad00-db1aca037a90 req-6b355e1c-4223-4b8c-9116-b246f0be38c3 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:42.200123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-d9adf32f-4240-4822-ad00-db1aca037a90 req-6b355e1c-4223-4b8c-9116-b246f0be38c3 service nova] Creating event network-vif-plugged:b783232c-084d-414d-9238-01324a0ba7cb for instance 08d58729-e3ad-4fab-9951-142b1802143b on hv-cinder-83697 Jun 21 10:45:42.205808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-d9adf32f-4240-4822-ad00-db1aca037a90 req-6b355e1c-4223-4b8c-9116-b246f0be38c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 Jun 21 10:45:42.206790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 415/803] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:45:42.348907 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:42.349527 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:42.356573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:42.357018 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:42.358258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:42.358575 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:42.661730 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:42.669704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5e7732f6-a86f-4913-b6ad-21919c01ab34 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.324690 Jun 21 10:45:42.670309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 389/804] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:42 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:43.690632 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:43.691338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:43.698351 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:43.698799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:43.699575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:43.700018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:43.846168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:43.854493 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fd80b850-baf3-436b-99a8-70740ff51001 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1264 microversion: 2.1 time: 0.170098 Jun 21 10:45:43.855287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 416/805] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:43 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:44.872774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:44.873465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:44.880841 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:44.881281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:44.882044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:44.882492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:45.035515 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:45.044044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1387b969-4411-40c4-a219-508885dc6341 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1451 microversion: 2.1 time: 0.175258 Jun 21 10:45:45.044893 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 390/806] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:44 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:45.062551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:45:45.063238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:45:45.070922 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:45.071412 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:45.072719 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:45.073195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:45.255969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:45:45.266939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9def2ca4-c1d4-4978-832a-0e7ab62426b0 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1451 microversion: 2.1 time: 0.208458 Jun 21 10:45:45.268204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 417/807] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:45:45 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1451 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:45:47.378736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-a4747b97-0039-4ee2-a04b-f2bb82360566 req-e4ebea8c-c455-4142-9d03-3d115f710517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d58729-e3ad-4fab-9951-142b1802143b", "tag": "b783232c-084d-414d-9238-01324a0ba7cb"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:45:47.389249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a4747b97-0039-4ee2-a04b-f2bb82360566 req-e4ebea8c-c455-4142-9d03-3d115f710517 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:45:47.389687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a4747b97-0039-4ee2-a04b-f2bb82360566 req-e4ebea8c-c455-4142-9d03-3d115f710517 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:45:47.402457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-a4747b97-0039-4ee2-a04b-f2bb82360566 req-e4ebea8c-c455-4142-9d03-3d115f710517 service nova] Creating event network-changed:b783232c-084d-414d-9238-01324a0ba7cb for instance 08d58729-e3ad-4fab-9951-142b1802143b on hv-cinder-83697 Jun 21 10:45:47.409693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-a4747b97-0039-4ee2-a04b-f2bb82360566 req-e4ebea8c-c455-4142-9d03-3d115f710517 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035048 Jun 21 10:45:47.410468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 391/808] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:03.394682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:03.395475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:03.566624 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:03.567122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:03.574394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:03.574888 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:03.575774 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:03.576265 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:03.608865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b1147a76-6e87-4e7a-a9c9-eb165a53ccff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/ips" status: 200 len: 144 microversion: 2.1 time: 0.218434 Jun 21 10:46:03.608865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 418/809] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:46:03 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/ips => generated 144 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:04.981990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:04.983271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=68 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:04.987624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62158b47-c4b1-4d80-afda-c57d67d5d1b6"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:04.988790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:04.996438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:04.996892 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:04.997680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:04.998130 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:05.292337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9fa7ba78-21e4-41da-a645-ae1a5e019ef9 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311550 Jun 21 10:46:05.293269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 392/810] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:46:04 2022] POST /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:12.877553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:12.878599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:12.886241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:12.886685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:12.887452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:12.887885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:12.923210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a0155d6b-b02b-4700-8592-0d2fc24dc9ff tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054081 Jun 21 10:46:12.923800 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 419/811] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:46:12 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:12.941703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:12.942599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:12.950745 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:12.951167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:12.952192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:12.952700 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:12.985809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-10de2b13-daee-42a1-806e-d3abb6404ebb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6" status: 200 len: 194 microversion: 2.1 time: 0.051262 Jun 21 10:46:12.986462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 393/812] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 21 10:46:12 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:15.413571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e48be6d3-81d3-4f72-bf3a-f9e18028f821"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:15.414681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:15.421310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:15.421750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:15.423247 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:15.423510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:15.724827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-39490b05-1a00-4e3e-9669-f9c1b53c3a72 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "POST /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315121 Jun 21 10:46:15.725627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 420/813] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:46:15 2022] POST /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:23.314913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:23.316066 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:23.318823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=4 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:23.319488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:23.329001 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.330240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.331270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.332062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.375300 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-762b6f62-7a18-40a7-8557-e0294e3ae5b3 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064689 Jun 21 10:46:23.375879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 394/814] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:46:23 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:46:23.528203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:23.528909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:23.536019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.536471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.537261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.537709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.569748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8e5ca4a5-abbc-4bb1-bf09-7299fb80ce89 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6" status: 200 len: 194 microversion: 2.1 time: 0.045975 Jun 21 10:46:23.570410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 421/815] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 21 10:46:23 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:23.581196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:23.581671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:23.588270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.588753 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.589505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:23.589954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:23.683838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lazy-loading 'services' on Instance uuid 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:46:23.763728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-453a469d-6608-4d5b-99fb-835c1161c528 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6" status: 202 len: 0 microversion: 2.1 time: 0.186771 Jun 21 10:46:23.764881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 395/816] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:46:23 2022] DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/62158b47-c4b1-4d80-afda-c57d67d5d1b6 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:46:25.950777 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:25.951378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:25.959231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:25.959827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:25.960603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:25.961033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:25.994248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6285e366-188a-491a-acfc-58ef7ca582a6 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/e48be6d3-81d3-4f72-bf3a-f9e18028f821" status: 200 len: 194 microversion: 2.1 time: 0.047928 Jun 21 10:46:25.994893 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 422/817] 10.222.0.43 () {58 vars in 1412 bytes} [Tue Jun 21 10:46:25 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/e48be6d3-81d3-4f72-bf3a-f9e18028f821 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:26.007356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:26.008037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:26.014750 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:26.015197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:26.015971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:26.016405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:26.109607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lazy-loading 'services' on Instance uuid 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:46:26.188345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-89cb3cfe-9f73-4fab-9c35-6e8b4875da6b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/e48be6d3-81d3-4f72-bf3a-f9e18028f821" status: 202 len: 0 microversion: 2.1 time: 0.185752 Jun 21 10:46:26.188999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 396/818] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:46:26 2022] DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments/e48be6d3-81d3-4f72-bf3a-f9e18028f821 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:46:27.382848 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:27.384395 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:27.392582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.393188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.394171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.394653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.426646 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ec15af7a-adae-44df-ba23-008c7139dfd5 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051662 Jun 21 10:46:27.428003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 423/819] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:46:27 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:46:27.552584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:27.553691 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:27.560465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.560899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.561682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.562148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.593056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f11b9fbd-82ee-43d5-a38c-9b1bfffb52c7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045411 Jun 21 10:46:27.593621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 397/820] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:46:27 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:46:27.652698 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:27.653365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:27.660161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.660615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.661498 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.661940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.687583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:46:27.772135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1529b3d7-39c7-4f02-a62c-bd2c876a9e5c tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 204 len: 0 microversion: 2.1 time: 0.123501 Jun 21 10:46:27.772771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 424/821] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:46:27 2022] DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:46:27.782609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:27.783247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:27.789674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.790152 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.790925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:27.791363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:27.933664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:27.941599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-359c76ad-6dd7-494c-ad56-1a851c4cc58b tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1672 microversion: 2.1 time: 0.163285 Jun 21 10:46:27.942176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 398/822] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:27 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:28.960563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:28.961287 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:28.968255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:28.968706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:28.969483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:28.969920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:29.114483 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:29.123961 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-243650c4-a0bc-4c6d-b500-61912421b768 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1672 microversion: 2.1 time: 0.167751 Jun 21 10:46:29.124530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 425/823] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:28 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:30.144422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:30.145384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:30.152446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:30.152896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:30.153681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:30.154150 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:30.442770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:30.452601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f1b25bb6-ef24-452c-a1c3-d1140bc8cbf7 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1672 microversion: 2.1 time: 0.313983 Jun 21 10:46:30.453458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 399/824] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:30 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:31.150148 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-0f550a8c-5667-47eb-89c3-50386a21fd42 req-d95b073f-0090-46a9-a479-57b04b74d0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3adc6835-6ebb-45b5-a1b4-a0002b38ca69", "name": "network-vif-deleted", "tag": "0af20033-2beb-4838-8763-bd647195b000"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:31.159062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0f550a8c-5667-47eb-89c3-50386a21fd42 req-d95b073f-0090-46a9-a479-57b04b74d0fd service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:31.159803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-0f550a8c-5667-47eb-89c3-50386a21fd42 req-d95b073f-0090-46a9-a479-57b04b74d0fd service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:31.176238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-0f550a8c-5667-47eb-89c3-50386a21fd42 req-d95b073f-0090-46a9-a479-57b04b74d0fd service nova] Creating event network-vif-deleted:0af20033-2beb-4838-8763-bd647195b000 for instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 on hv-cinder-83697 Jun 21 10:46:31.183119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-0f550a8c-5667-47eb-89c3-50386a21fd42 req-d95b073f-0090-46a9-a479-57b04b74d0fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117114 Jun 21 10:46:31.187789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 426/825] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:31.471206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:31.471931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:31.478972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:31.479422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:31.480192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:31.480617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:31.514166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:31.514886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:31.515361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lazy-loading 'fault' on Instance uuid 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:46:31.566335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d6e222d654e66b38fcefeff65fe80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadbbbf08f7b44ce8594f389765f35b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:31.575075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8e809878-318b-4980-80a5-3704c2573acb tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 200 len: 1328 microversion: 2.1 time: 0.107744 Jun 21 10:46:31.575911 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 400/826] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:31 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:32.594612 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:32.595308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:32.604824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:32.605627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:32.606785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:32.607394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:32.621912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 HTTP/1.1 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:46:32.623609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:32.625372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '3adc6835-6ebb-45b5-a1b4-a0002b38ca69'} Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:32.626555 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:32.628130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:32.629446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:32.629446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f6877489-889c-44c5-ac67-4f92db76c657 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 404 len: 111 microversion: 2.1 time: 0.035377 Jun 21 10:46:32.629446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 427/827] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:32 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:46:32.634789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a5570030-b4f9-4c21-8263-4d533e9a67cf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '.version_select at 0x7f8a35cc1af0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:32.655566 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a5570030-b4f9-4c21-8263-4d533e9a67cf tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275919704" status: 202 len: 0 microversion: 2.1 time: 0.024544 Jun 21 10:46:32.656204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 401/828] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 21 10:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275919704 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:46:35.664445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:35.664976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:35.667480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:35.673187 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:35.673635 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:35.674460 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:35.674898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:35.678663 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:35.692246 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 HTTP/1.1 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:46:35.693959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.695983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '3adc6835-6ebb-45b5-a1b4-a0002b38ca69'} Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:35.697920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.700628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.702903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:35.702903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-92f28767-32ef-4d1f-a748-4289d11eae8d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 404 len: 111 microversion: 2.1 time: 0.035781 Jun 21 10:46:35.702903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 428/829] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:46:35 2022] DELETE /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:46:35.706708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:35.707336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 3adc6835-6ebb-45b5-a1b4-a0002b38ca69] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:35.714667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:35.715116 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:35.715865 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:35.716335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:35.730782 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 HTTP/1.1 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:46:35.732458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.733946 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '3adc6835-6ebb-45b5-a1b4-a0002b38ca69'} Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:35.734835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. Jun 21 10:46:35.736151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:35.737233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 3adc6835-6ebb-45b5-a1b4-a0002b38ca69 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:35.737233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-06de91e3-1053-44e6-875e-6921bca3d733 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69" status: 404 len: 111 microversion: 2.1 time: 0.031749 Jun 21 10:46:35.737233 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 402/830] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:35 2022] GET /compute/v2.1/servers/3adc6835-6ebb-45b5-a1b4-a0002b38ca69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:46:36.892647 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:36.893212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:36.902036 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:36.902651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:36.903428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:36.903863 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:36.918553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e HTTP/1.1 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:46:36.920103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.921690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '41dcf0af-2c3f-40a6-82a7-86f4be479e9e'} Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:36.922614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.924063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.925461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:36.925461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f9d6c00c-2ccc-4d5c-8c11-e443a5a7def4 tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 404 len: 111 microversion: 2.1 time: 0.032791 Jun 21 10:46:36.925461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 429/831] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:46:36 2022] DELETE /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:46:36.930299 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:36.930947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] [instance: 41dcf0af-2c3f-40a6-82a7-86f4be479e9e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:36.937952 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:36.938432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:36.939223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:36.939634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:36.954287 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] HTTP exception thrown: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Request method failure captured: Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e HTTP/1.1 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ764OM75TdbHy3qp-KHnycrb5Uptz6aSk0KfH5AMjk-xf5WbNCR2eRpLHGnnVnFcmCAu5smEX2Hot3Z3gujPtmE_BaVM_OtNqd9tEodDp8GKoDSb7eQ20j4DFAA_1f1HHDZhJ4NgIulGFdnozs7C7j_F3xxEFV4_-R7CRJ2Qq4euQg Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:46:36.955800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dadbbbf08f7b44ce8594f389765f35b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dadbbbf08f7b44ce8594f389765f35b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dadbbbf08f7b44ce8594f389765f35b2"}]}] Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: dadbbbf08f7b44ce8594f389765f35b2 Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999739970 Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: f58d6e222d654e66b38fcefeff65fe80 Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeTestJSON-999739970-project Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.957431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '41dcf0af-2c3f-40a6-82a7-86f4be479e9e'} Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:36.958345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. Jun 21 10:46:36.959929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:36.961281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] Returning 404 to user: Instance 41dcf0af-2c3f-40a6-82a7-86f4be479e9e could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:36.961281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3d1e6464-d9bc-4d82-94d5-1b94ebabc19d tempest-AttachVolumeTestJSON-999739970 tempest-AttachVolumeTestJSON-999739970-project] 10.222.0.43 "GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e" status: 404 len: 111 microversion: 2.1 time: 0.030945 Jun 21 10:46:36.961281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 403/832] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:36 2022] GET /compute/v2.1/servers/41dcf0af-2c3f-40a6-82a7-86f4be479e9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:46:39.274562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:39.275338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:39.285854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:39.287250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:39.289558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:39.289747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-51d4dc3a-b55f-4ebf-a17d-9514c0f73bb8 req-26012ffa-a8f4-46b7-bc47-8e5d0c8256ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:39.290889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:39.298619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-51d4dc3a-b55f-4ebf-a17d-9514c0f73bb8 req-26012ffa-a8f4-46b7-bc47-8e5d0c8256ff service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:39.299380 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-51d4dc3a-b55f-4ebf-a17d-9514c0f73bb8 req-26012ffa-a8f4-46b7-bc47-8e5d0c8256ff service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:39.313768 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-51d4dc3a-b55f-4ebf-a17d-9514c0f73bb8 req-26012ffa-a8f4-46b7-bc47-8e5d0c8256ff service nova] Creating event network-changed:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:46:39.319825 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-51d4dc3a-b55f-4ebf-a17d-9514c0f73bb8 req-26012ffa-a8f4-46b7-bc47-8e5d0c8256ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034712 Jun 21 10:46:39.320803 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 404/833] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:46:39.326142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:46:39.554326 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c8604ca6-fca8-48c3-8870-bbfdf931170f tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "DELETE /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 204 len: 0 microversion: 2.1 time: 0.269719 Jun 21 10:46:39.556341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 430/834] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:46:39 2022] DELETE /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:46:39.571117 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:39.573072 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:39.590020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:39.591534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:39.593174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:39.594254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:39.880878 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:39.890785 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-89ee6586-0bc9-450d-b7b9-2d7be72da2e2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.328485 Jun 21 10:46:39.891743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 405/835] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:39 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:40.922221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:40.923790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:40.935659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:40.936377 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:40.938011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:40.938709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:41.136620 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:41.145106 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0d4bcb6f-cfd7-45f3-9395-cc14acae365a tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1568 microversion: 2.1 time: 0.232824 Jun 21 10:46:41.145839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 431/836] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:40 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:41.513298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:41.514137 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:41.521468 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:41.522172 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:41.523207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:41.523776 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:41.549131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fd5ee61d-2b87-46bc-8ffd-197a7d6127d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/ips" status: 200 len: 151 microversion: 2.20 time: 0.040299 Jun 21 10:46:41.550155 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 406/837] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Jun 21 10:46:41 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:46:42.044962 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-9abb3ee9-ab12-4792-8fd5-2a9427cfcfa6 req-1e12b17c-9628-44df-b218-e56d3d6f60e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111bcc36-f3e4-4b69-9a4c-a533b2bee4c3", "name": "network-vif-deleted", "tag": "2cc4b96a-2975-4c9b-8d8c-a221f247f3c0"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:42.054107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-9abb3ee9-ab12-4792-8fd5-2a9427cfcfa6 req-1e12b17c-9628-44df-b218-e56d3d6f60e1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:42.054657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-9abb3ee9-ab12-4792-8fd5-2a9427cfcfa6 req-1e12b17c-9628-44df-b218-e56d3d6f60e1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:42.066993 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-9abb3ee9-ab12-4792-8fd5-2a9427cfcfa6 req-1e12b17c-9628-44df-b218-e56d3d6f60e1 service nova] Creating event network-vif-deleted:2cc4b96a-2975-4c9b-8d8c-a221f247f3c0 for instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 on hv-cinder-83697 Jun 21 10:46:42.074999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-9abb3ee9-ab12-4792-8fd5-2a9427cfcfa6 req-1e12b17c-9628-44df-b218-e56d3d6f60e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Jun 21 10:46:42.075605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 432/838] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:42.162256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:42.163243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:42.169603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:42.170076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:42.170982 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:42.171422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:42.236206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:42.245238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-870ba463-310e-4abe-8920-a5fc79b2f8a2 tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1219 microversion: 2.1 time: 0.086908 Jun 21 10:46:42.245882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 407/839] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:42 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:43.265138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:43.266038 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:43.283904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:43.284837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:43.286814 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:43.287696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:43.342477 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:43.343060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:43.343644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lazy-loading 'fault' on Instance uuid 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:46:43.402503 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0579a5ba91a4aa89b676598b6d9dfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07dc511991f4d9f87aa5256f76e402c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:43.411244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f997664a-07fc-4363-98f6-83a324df495e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 200 len: 1224 microversion: 2.1 time: 0.152225 Jun 21 10:46:43.415111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 433/840] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:43 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:43.665819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:43.666449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:43.674524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:43.686006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:43.687394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:43.689119 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:43.718629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lazy-loading 'flavor' on Instance uuid 21bd820c-b0da-4004-abbc-216348f04c3f {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:46:44.075809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b6a8bec8-820b-4362-9590-391067925429 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/action" status: 202 len: 0 microversion: 2.20 time: 0.414747 Jun 21 10:46:44.076458 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 408/841] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 21 10:46:43 2022] POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:46:44.090538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:44.092631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:44.101929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:44.102955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:44.104176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:44.104810 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:44.260625 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:44.272439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:44.273931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:44.275171 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-48336b41-f657-4163-b311-05929063a5c6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.193601 Jun 21 10:46:44.277064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 434/842] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:44 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:44.432495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:44.433200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] [instance: 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:44.442951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:44.444471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:44.444471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:44.444783 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:44.461385 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] HTTP exception thrown: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Request method failure captured: Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 HTTP/1.1 Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisZ_kXcswI-cnTMpF4P01_poutsRbtRPwh7w_sscsXKcHFTOeN31b494nOP3ezH6lIUQ8qTqO1XJ5y5Mlnuqe9rAA18nqjtzLME2VO82r7Y7ZMTtAoDQXhBFyFheuI2c2X_lDXt0RwRghMA5QwLVQSg5G4rOMcKhx_W1JfohhUoldntY Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: f07dc511991f4d9f87aa5256f76e402c Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-TestShelveInstance-598162601 Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:46:44.462962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f07dc511991f4d9f87aa5256f76e402c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f07dc511991f4d9f87aa5256f76e402c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f07dc511991f4d9f87aa5256f76e402c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f07dc511991f4d9f87aa5256f76e402c"}]}] Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-TestShelveInstance-598162601 Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: f07dc511991f4d9f87aa5256f76e402c Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-TestShelveInstance-598162601 Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-TestShelveInstance-598162601-project Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: c0579a5ba91a4aa89b676598b6d9dfeb Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-TestShelveInstance-598162601-project Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. Jun 21 10:46:44.465686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '111bcc36-f3e4-4b69-9a4c-a533b2bee4c3'} Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:46:44.467275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. Jun 21 10:46:44.470355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:46:44.473554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Returning 404 to user: Instance 111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:46:44.473554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a9259ca5-e7f0-4886-ad34-c836da06b17b tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3" status: 404 len: 111 microversion: 2.1 time: 0.036680 Jun 21 10:46:44.473554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 409/843] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:44 2022] GET /compute/v2.1/servers/111bcc36-f3e4-4b69-9a4c-a533b2bee4c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:46:44.668184 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a8d7236d-5fa7-4e9f-8ff1-e97367b84a6e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] Calling method '.version_select at 0x7f8a35d49310>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:44.692482 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a8d7236d-5fa7-4e9f-8ff1-e97367b84a6e tempest-TestShelveInstance-598162601 tempest-TestShelveInstance-598162601-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-238040267" status: 202 len: 0 microversion: 2.1 time: 0.028137 Jun 21 10:46:44.693402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 435/844] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jun 21 10:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-238040267 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:46:45.300826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:45.302014 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:45.313781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:45.314455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:45.315433 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:45.316028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:46.156592 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:46.170838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:46.184813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:46.187686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:46.189384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6dfd3694-985f-43db-bcb2-c58a31c0e3d0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.898542 Jun 21 10:46:46.190759 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 410/845] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:45 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:47.216145 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:47.220866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:47.237912 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:47.248150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:47.249125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:47.249566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:47.495230 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:47.508725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:47.512072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:47.513845 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f603ec8d-805a-4c92-a159-8da158cd6141 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.307881 Jun 21 10:46:47.514960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 436/846] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:47 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:48.534082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:48.535413 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:48.547026 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:48.547518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:48.548290 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:48.548716 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:48.727436 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:48.739903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:48.746345 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:48.747603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-27fc5a4c-52ec-48a3-a399-d461b276fe69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.218269 Jun 21 10:46:48.753511 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 411/847] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:48 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:48.838379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ff1a183c-3b2d-4ba1-a3ed-b7a2b89d9d01 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: .version_select at 0x7f8a35d70d30>, body: {"keypair": {"name": "tempest-keypair-496532046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jkXvYR/0LZxMhgnpR4STn6TCx6PdRujPDj83fbUwZPLdJ+WPrPoEprKDvZEp2Qnibl36rAt9tbUJn10xpLlvujLVfmOkI5b/o57i8x7W3Cz1NvIUcZK5sTfLWaHcnZA=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:48.862289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-ff1a183c-3b2d-4ba1-a3ed-b7a2b89d9d01 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:46:48.866997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-ff1a183c-3b2d-4ba1-a3ed-b7a2b89d9d01 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:46:48.900152 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ff1a183c-3b2d-4ba1-a3ed-b7a2b89d9d01 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.255049 Jun 21 10:46:48.900805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 437/848] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:46:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:46:49.769330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:49.771006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:49.783645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:49.792668 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:49.794070 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:49.794722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:50.117900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:50.132081 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:50.133645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:50.134882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5a5a41fa-11ea-49ee-8cdc-ff41369211e1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.369634 Jun 21 10:46:50.135456 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 412/849] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:49 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:51.169184 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:51.169803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:51.241479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:51.250745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:51.251705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:51.252163 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:51.368937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305960710", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e610a6-095a-475b-879f-4c63a030f200"}], "security_groups": [{"name": "tempest-securitygroup--1892260586"}], "key_name": "tempest-keypair-496532046", "user_data": "}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:51.499752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] validate_networks() for [('d4e610a6-095a-475b-879f-4c63a030f200', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:46:51.591923 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:51.606259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:51.608636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:51.610222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7588ed69-9c1c-4579-b2fa-580247bcd5e8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.457735 Jun 21 10:46:51.611014 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 438/850] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:51 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:52.378729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:46:52.379519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:46:52.379850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:46:52.380390 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:46:52.381933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:46:52.393789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:52.399644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:52.400787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:52.401336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:52.430334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:46:52.433420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:46:52.449377 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:46:52.450877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:46:52.524422 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-06750976-cdd8-413d-8453-fce272caa548 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.166240 Jun 21 10:46:52.533459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 413/851] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:46:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:46:52.544100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-305b060d-4d71-4e53-8bfa-af8ca82048ae tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:52.545728 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-305b060d-4d71-4e53-8bfa-af8ca82048ae tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:52.632835 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:52.633746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:52.648467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:52.650654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:52.652120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-305b060d-4d71-4e53-8bfa-af8ca82048ae tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:52.652937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:52.654240 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:52.666784 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-305b060d-4d71-4e53-8bfa-af8ca82048ae tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1240 microversion: 2.1 time: 0.126677 Jun 21 10:46:52.668713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 439/852] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:52 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:52.860284 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:52.873651 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:52.875267 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:52.876574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9f2b7408-6bfc-403b-8999-ab26e0dcc0dd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.251692 Jun 21 10:46:52.877196 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 414/853] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:52 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:46:53.687792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:53.689007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:53.702669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:53.703731 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:53.704733 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:53.705949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:53.806780 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:53.828083 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-34662afb-e761-4f94-bfc3-9de7007e3d77 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1300 microversion: 2.1 time: 0.144296 Jun 21 10:46:53.829264 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 440/854] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:53 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:53.895291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:53.896212 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:53.901346 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:53.922597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:53.929556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:53.929556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:53.932379 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:54.173823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:54.189797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:54.192809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:54.196680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-18cda5f7-f956-49e8-a954-cd8098ef92d6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.303615 Jun 21 10:46:54.196680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 415/855] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:53 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:54.845791 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:54.847137 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:54.859073 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:54.859845 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:54.860743 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:54.861426 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:55.051129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:55.076256 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c54a4d1d-e948-4ae1-a4e5-66bda09d0259 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.234026 Jun 21 10:46:55.077235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 441/856] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:54 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:55.216319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:55.217624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:55.224231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:55.225101 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:55.226170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:55.226773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:55.527087 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:55.545679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:55.548218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:55.549947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9ecc9c54-a302-45c8-b517-81b17eb019a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.337849 Jun 21 10:46:55.550529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 416/857] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:55 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:55.714717 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-3c967e3a-1416-4766-b77f-aa9f2e2e8635 req-c4590700-1ff5-499a-a974-b57e5032811d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6413e8-d55e-46f6-a18a-e3c5a528735e", "tag": "8cd9881e-2aa1-449a-9564-6007e91f5b51"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:46:55.725204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3c967e3a-1416-4766-b77f-aa9f2e2e8635 req-c4590700-1ff5-499a-a974-b57e5032811d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:55.726830 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3c967e3a-1416-4766-b77f-aa9f2e2e8635 req-c4590700-1ff5-499a-a974-b57e5032811d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:55.752133 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-3c967e3a-1416-4766-b77f-aa9f2e2e8635 req-c4590700-1ff5-499a-a974-b57e5032811d service nova] Creating event network-changed:8cd9881e-2aa1-449a-9564-6007e91f5b51 for instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e on hv-cinder-83697 Jun 21 10:46:55.765503 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-3c967e3a-1416-4766-b77f-aa9f2e2e8635 req-c4590700-1ff5-499a-a974-b57e5032811d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051571 Jun 21 10:46:55.765503 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 442/858] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:46:56.096961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:56.097636 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:56.103888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:56.104332 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:56.105092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:56.105523 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:56.313814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:56.321852 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2e21c7ce-7a67-4b17-a0c3-87317c33ed0b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.228740 Jun 21 10:46:56.322818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 417/859] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:56 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:56.570904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:56.571616 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:56.578842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:56.579290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:56.580055 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:56.580479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:56.722707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:56.731931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:56.733418 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:56.734652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0ef2d5f7-26d6-4220-afd6-2fdbe0dcbaea tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.168839 Jun 21 10:46:56.735203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 443/860] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:56 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:57.340080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:57.341363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:57.348282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:57.348747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:57.349535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:57.349977 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:57.503757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:57.512574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-428fee7f-86d1-42a7-b6e8-3a5468feeafb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.176642 Jun 21 10:46:57.513195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 418/861] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:57 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:57.762489 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:57.763200 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:57.773322 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:57.774156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:57.775562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:57.776353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:57.936493 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:57.945273 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:57.947715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:57.948907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6987e54c-56fe-4f15-b37d-2cc3a03145b4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.192673 Jun 21 10:46:57.949446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 444/862] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:57 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:58.531025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:58.531628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:58.538343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:58.538785 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:58.539679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:58.540195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:58.761855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:58.773041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-457cb91a-44d0-486e-b960-afc7830519f4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.245758 Jun 21 10:46:58.773644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 419/863] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:58 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:46:58.967186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:58.967991 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:58.975655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:58.976337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:58.977542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:58.978002 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:59.136885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:59.145595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:59.147141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:46:59.148350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d98d8caa-bff1-435e-bce4-113a64ccf929 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.185309 Jun 21 10:46:59.148914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 445/864] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:46:58 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:46:59.792499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:46:59.793139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:46:59.800084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:59.800531 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:46:59.801298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:46:59.801735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:00.101844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:00.109831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-980adab1-a5cf-4caf-adcd-a07ea2a54d1e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.321328 Jun 21 10:47:00.110407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 420/865] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:46:59 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:00.167288 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:00.167880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:00.174724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:00.175173 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:00.175931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:00.176362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:00.313197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:00.327879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:00.330331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:00.332186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-258d2cf9-31df-40c6-866f-a23de15d56a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.169080 Jun 21 10:47:00.333039 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 446/866] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:00 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:01.130167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:01.130770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:01.141333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:01.141901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:01.143360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:01.144146 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:01.280943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:01.290727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-886a6c1f-0497-45bf-971f-a6a2a40bca41 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.166252 Jun 21 10:47:01.291682 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 421/867] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:01 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:01.351602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:01.352231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:01.361045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:01.361490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:01.362289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:01.362709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:01.516641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:01.524673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:01.526678 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:01.527845 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-de7efd65-d6b1-4b58-ab73-63fea9f99e0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1743 microversion: 2.20 time: 0.180145 Jun 21 10:47:01.528402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 447/868] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:01 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:02.310457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:02.311073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:02.317963 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:02.318473 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:02.319246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:02.319678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:02.416667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:02.443494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:02.463339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:02.472081 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7f31eeb1-402b-4859-b2b0-ed80ffb77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.166883 Jun 21 10:47:02.472650 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 422/869] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:02 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:02.546195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:02.546989 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:02.553975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:02.554496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:02.555306 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:02.555738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:02.573001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:02.665011 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:02.700598 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:02.702006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-d62a84c2-0fdd-4c37-916c-eae6ef556e38 req-ba4a1700-405a-449d-b800-c1ec5958a61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6413e8-d55e-46f6-a18a-e3c5a528735e", "name": "network-vif-plugged", "status": "completed", "tag": "8cd9881e-2aa1-449a-9564-6007e91f5b51"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:02.710307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:02.711226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-d62a84c2-0fdd-4c37-916c-eae6ef556e38 req-ba4a1700-405a-449d-b800-c1ec5958a61e service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:02.711867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-d62a84c2-0fdd-4c37-916c-eae6ef556e38 req-ba4a1700-405a-449d-b800-c1ec5958a61e service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:02.712229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:02.713936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-55f26960-1fe0-4a9c-94d2-b21cec13f179 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1743 microversion: 2.20 time: 0.171458 Jun 21 10:47:02.714521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 448/870] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:02 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:02.725514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-d62a84c2-0fdd-4c37-916c-eae6ef556e38 req-ba4a1700-405a-449d-b800-c1ec5958a61e service nova] Creating event network-vif-plugged:8cd9881e-2aa1-449a-9564-6007e91f5b51 for instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e on hv-cinder-83697 Jun 21 10:47:02.731837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-d62a84c2-0fdd-4c37-916c-eae6ef556e38 req-ba4a1700-405a-449d-b800-c1ec5958a61e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Jun 21 10:47:02.732297 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 423/871] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:47:03.490645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:03.491411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:03.498644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:03.499088 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:03.499875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:03.500337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:03.647561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:03.665806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a55e2718-a111-40a1-946d-7815ae72d77f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.178704 Jun 21 10:47:03.666664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 449/872] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:03 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:03.733927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:03.734699 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:03.741184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:03.741644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:03.742442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:03.742879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:03.887122 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:03.895475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:03.896957 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:03.898311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-17d543f2-14f5-4c46-aa47-78cedf596b5b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1743 microversion: 2.20 time: 0.169645 Jun 21 10:47:03.898878 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 424/873] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:03 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:04.684084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:04.684799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:04.691736 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:04.692185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:04.692961 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:04.693396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:04.755073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-1badaf63-4a56-4f25-b3a2-3010ada2f6df req-f0a9f60d-addc-4bae-890e-30edd5df0ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "name": "network-vif-plugged", "status": "completed", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:04.770542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1badaf63-4a56-4f25-b3a2-3010ada2f6df req-f0a9f60d-addc-4bae-890e-30edd5df0ef7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:04.771238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1badaf63-4a56-4f25-b3a2-3010ada2f6df req-f0a9f60d-addc-4bae-890e-30edd5df0ef7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:04.792112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-1badaf63-4a56-4f25-b3a2-3010ada2f6df req-f0a9f60d-addc-4bae-890e-30edd5df0ef7 service nova] Creating event network-vif-plugged:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:47:04.800178 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-1badaf63-4a56-4f25-b3a2-3010ada2f6df req-f0a9f60d-addc-4bae-890e-30edd5df0ef7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052861 Jun 21 10:47:04.800792 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 425/874] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:47:04.843765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:04.851675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-46f97aa8-a5c4-4351-a146-6e623a3fb404 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1366 microversion: 2.1 time: 0.171455 Jun 21 10:47:04.852250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 450/875] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:04 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:04.918266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:04.919148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:04.926120 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:04.926658 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:04.927439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:04.927980 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:05.070779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:05.081291 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:05.082818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:05.084025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-140e32f8-c55e-4186-ad6e-e67d3867b9ff tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1743 microversion: 2.20 time: 0.170574 Jun 21 10:47:05.084573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 426/876] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:04 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:05.869452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:05.870102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:05.872399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:05.878900 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:05.879338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:05.880105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:05.880529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:06.033084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:06.041099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b1ceb269-46e7-494a-933e-13a8405cb593 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1557 microversion: 2.1 time: 0.175559 Jun 21 10:47:06.041673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 451/877] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:05 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:06.058911 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:06.059626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:06.066894 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:06.067282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:06.068067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:06.068500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:06.103188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:06.103513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:06.110921 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:06.111366 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:06.112173 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:06.112602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:06.153743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bd0fd347-c1c7-4c17-bb14-e87fd1f4e401 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098733 Jun 21 10:47:06.154415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 427/878] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:47:06 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:47:06.383809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:06.392547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:06.394044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:06.395262 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc1ca091-f8c2-4e51-bbd6-1ec23d994d75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1743 microversion: 2.20 time: 0.296332 Jun 21 10:47:06.395825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 452/879] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:06 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1743 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:07.415036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:07.416964 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:07.427821 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:07.428678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:07.431705 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:07.432843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:07.620632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:07.632076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:07.633607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:07.635124 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5e48290a-1e08-4112-b86f-9c5c9819928b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.225273 Jun 21 10:47:07.636131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 428/880] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:07 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:07.703984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-ea40085b-5641-4d8a-9c9a-e5deed709884 req-116cd2e3-a866-4778-82be-a301a3ee95e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6413e8-d55e-46f6-a18a-e3c5a528735e", "tag": "8cd9881e-2aa1-449a-9564-6007e91f5b51"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:07.714075 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-ea40085b-5641-4d8a-9c9a-e5deed709884 req-116cd2e3-a866-4778-82be-a301a3ee95e1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:07.714831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-ea40085b-5641-4d8a-9c9a-e5deed709884 req-116cd2e3-a866-4778-82be-a301a3ee95e1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:07.730566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-ea40085b-5641-4d8a-9c9a-e5deed709884 req-116cd2e3-a866-4778-82be-a301a3ee95e1 service nova] Creating event network-changed:8cd9881e-2aa1-449a-9564-6007e91f5b51 for instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e on hv-cinder-83697 Jun 21 10:47:07.737160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-ea40085b-5641-4d8a-9c9a-e5deed709884 req-116cd2e3-a866-4778-82be-a301a3ee95e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041379 Jun 21 10:47:07.738434 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 453/881] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:47:08.655867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:08.656474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:08.664816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:08.665274 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:08.666159 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:08.666875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:08.824331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:08.829521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=100 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:08.840036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:08.841703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:08.843102 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c81f5574-1d9b-4dee-855f-6c8927ccbf38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.191458 Jun 21 10:47:08.854670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 429/882] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:08 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:09.864578 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:09.865324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:09.873032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:09.873501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:09.874541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:09.874937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:10.055283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:10.079032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:10.080895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:10.082343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc1a3ee2-280e-4ef6-ae91-ac5bec70737d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.223058 Jun 21 10:47:10.083067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 454/883] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:09 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:11.103612 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:11.105722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:11.142683 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:11.143573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:11.144963 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:11.145734 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:11.349549 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:11.359373 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:11.361700 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:11.363203 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-89935f22-0e9b-4548-983f-ac488b56267f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.263721 Jun 21 10:47:11.375129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 430/884] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:11 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:12.389046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:12.389959 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:12.398336 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:12.398792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:12.399577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:12.400016 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:12.603003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:12.616096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:12.618448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:12.619716 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-24c5afdc-3ade-427d-9a9a-57385ceb952e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.240010 Jun 21 10:47:12.620898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 455/885] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:12 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:13.643707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:13.645190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:13.656391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:13.656925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:13.657765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:13.658481 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:13.822519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:13.832750 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:13.835842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:13.837634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-00d2b178-ee2e-41e5-97eb-fffac7100499 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.197907 Jun 21 10:47:13.838202 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 431/886] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:13 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:14.862981 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:14.863602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:14.875837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:14.876757 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:14.878494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:14.879384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:15.108805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:15.119477 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:15.120996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:15.122212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-58af4ee5-46df-4ea4-82f7-17dd7a3abc69 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.263407 Jun 21 10:47:15.122919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 456/887] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:14 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:16.141661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:16.142415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:16.149462 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:16.149904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:16.150719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:16.151141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:16.310660 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:16.320354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:16.321849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:16.323453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d0cc2924-0637-4060-8329-3c98e6f4b7e7 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1738 microversion: 2.20 time: 0.186244 Jun 21 10:47:16.324024 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 432/888] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:16 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:17.349477 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:17.350819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:17.363392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:17.364200 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:17.365587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:17.366372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:17.510257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:17.521566 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:17.523102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:17.524306 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1d5e8e83-14ac-40ec-9d7c-2f1107ff413d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1720 microversion: 2.20 time: 0.182623 Jun 21 10:47:17.524847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 457/889] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:17 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:18.543243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:18.544086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:18.551778 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:18.552222 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:18.552997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:18.553428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:18.717423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:18.728229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:18.730229 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:18.731474 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-315c1911-0f70-403b-9576-d3f92b4770a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1720 microversion: 2.20 time: 0.192363 Jun 21 10:47:18.732760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 433/890] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:18 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:19.752558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:19.753189 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:19.760139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:19.760641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:19.761420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:19.761886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:19.911084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:19.919700 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:19.922092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:19.923402 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-61796c01-0aad-4a08-a951-eb482b203e85 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1663 microversion: 2.20 time: 0.175429 Jun 21 10:47:19.923964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 458/891] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:19 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:19.941451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696bd78a-3de0-4281-b4b6-e5d808bb11c5"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:19.942591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:19.950201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:19.950652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:19.951430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:19.951957 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:20.267198 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7205ce92-7610-46d2-a675-2a1d9c63e4a8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329799 Jun 21 10:47:20.268179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 434/892] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Jun 21 10:47:19 2022] POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:47:20.397380 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:20.397956 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:20.404202 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:20.404648 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:20.405834 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:20.406295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:20.516091 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:47:20.599508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-2da947ae-73af-47f4-a400-4e227b513ba3 req-7fd83674-4146-41f4-ae2d-00144f529927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "name": "network-vif-unplugged", "status": "completed", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:20.610044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-2da947ae-73af-47f4-a400-4e227b513ba3 req-7fd83674-4146-41f4-ae2d-00144f529927 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:20.610553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-2da947ae-73af-47f4-a400-4e227b513ba3 req-7fd83674-4146-41f4-ae2d-00144f529927 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:20.622273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.compute.server_external_events [req-2da947ae-73af-47f4-a400-4e227b513ba3 req-7fd83674-4146-41f4-ae2d-00144f529927 service nova] Unable to find a host for instance 21bd820c-b0da-4004-abbc-216348f04c3f. Dropping event network-vif-unplugged {{(pid=124180) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 10:47:20.623193 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-2da947ae-73af-47f4-a400-4e227b513ba3 req-7fd83674-4146-41f4-ae2d-00144f529927 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028016 Jun 21 10:47:20.623927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 435/893] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 21 10:47:21.523838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51956. Jun 21 10:47:21.528043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-62a321ae-1736-4bd3-b6c5-53eefa1a63b8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/action" status: 202 len: 0 microversion: 2.20 time: 1.134638 Jun 21 10:47:21.528619 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 459/894] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 21 10:47:20 2022] POST /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:47:21.536876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:21.538293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:21.545788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:21.546289 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:21.548020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:21.548600 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:21.695586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:21.705598 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:21.707190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:21.708393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b178e3bb-1e3a-4ad2-b0fd-bf5bb42020a3 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1749 microversion: 2.20 time: 0.175514 Jun 21 10:47:21.708951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 436/895] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:21 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:22.735788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:22.736372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:22.743744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:22.744201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:22.744979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:22.745417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:22.891296 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:22.900432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:22.901922 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:22.903127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-669a34ca-ac50-4af8-aeb5-44d1a8a7079e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1751 microversion: 2.20 time: 0.172405 Jun 21 10:47:22.903683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 460/896] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:22 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:23.923494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:23.924119 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:23.931872 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:23.932471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:23.933335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:23.933998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:24.169031 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:24.179195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:24.180633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:24.181870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-40eb69dc-1176-4e8a-ad8e-f66f31af413e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.262561 Jun 21 10:47:24.183624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 437/897] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:23 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:25.202695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:25.203762 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:25.210697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:25.211445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:25.212263 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:25.212902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:25.388285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:25.398732 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:25.400286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:25.401436 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-675738fd-d688-4504-bc4c-89b0239d3c8c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.202819 Jun 21 10:47:25.402006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 461/898] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:25 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:26.429433 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:26.430250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:26.433074 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=46 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:26.439145 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:26.439609 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:26.440460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:26.440891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:26.605102 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:26.614626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:26.616103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:26.617275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1087bb0c-4e50-41e6-ad52-6eccf0fdcb6e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.192184 Jun 21 10:47:26.617854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 438/899] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:26 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:27.637067 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:27.637773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:27.646662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:27.647236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:27.648122 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:27.649003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:27.808901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:27.821783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:27.823715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:27.824926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-17668800-be6a-4b15-8b05-2e25b2d8613d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.192016 Jun 21 10:47:27.825838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 462/900] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:27 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:28.843703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:28.844384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:28.851183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:28.852059 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:28.853086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:28.853752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:29.031158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:29.040492 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:29.042037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:29.043355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-96540826-1fc7-48f8-b814-6a782892cc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.204048 Jun 21 10:47:29.044151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 439/901] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:28 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:47:30.063000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:30.063939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:30.070842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:30.071292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:30.072427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:30.072861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:30.246595 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:30.257233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:30.258792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:30.259998 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-acf34030-1e77-4aea-81cb-f38f3b1e862a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.201115 Jun 21 10:47:30.260562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 463/902] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:30 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:31.281362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:31.282891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:31.291163 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:31.291642 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:31.292469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:31.292905 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:31.441542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:31.450694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:31.452184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:31.453331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fba26712-831c-4583-a18b-ad10391aedee tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.177472 Jun 21 10:47:31.454607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 440/903] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:31 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:32.477310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:32.477946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:32.485353 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:32.485969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:32.486806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:32.487237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:32.661321 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:32.664047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:32.673164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:32.674759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:32.675936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a29fda0f-c643-4f3b-8efb-26773df4aa58 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.202797 Jun 21 10:47:32.676526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 464/904] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:32 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:33.698546 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:33.699219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:33.706391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:33.706843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:33.707628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:33.708065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:33.859944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:33.868818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:33.870362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:33.871557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b53bcce9-f9a3-461b-bd45-d5b731d87175 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.178193 Jun 21 10:47:33.872116 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 441/905] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:33 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:34.893065 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:34.893744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:34.902788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:34.903354 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:34.904338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:34.904853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:35.060968 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:35.070670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:35.074514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:35.074514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3792e168-e04a-4004-b6a8-4814d0b6451f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.187106 Jun 21 10:47:35.074514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 465/906] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:34 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:36.092996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:36.093653 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:36.101699 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:36.102176 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:36.102944 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:36.103370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:36.246655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:36.256761 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:36.258310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:36.259537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e9d3cc6a-0c9b-464c-ba4f-b57a6daedc7d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.170540 Jun 21 10:47:36.260360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 442/907] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:36 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:37.277181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:37.277755 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:37.280349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=32 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:37.286710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:37.287132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:37.287744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:37.288177 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:37.461323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:37.472250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:37.473955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:37.476820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-81778c3d-b3f3-400c-a34c-ee1df16506c9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.203738 Jun 21 10:47:37.477371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 466/908] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:37 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:38.499537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:38.500379 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:38.507250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:38.507690 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:38.508455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:38.508901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:38.659272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:38.678532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:38.680034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:38.681234 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2142203e-115e-48ec-b6fe-a1aae9d2e675 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.188145 Jun 21 10:47:38.681797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 443/909] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:38 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:39.700234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:39.701003 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:39.708104 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:39.708550 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:39.709317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:39.709747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:39.875985 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:39.886384 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:39.887909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:39.889077 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-920d5bc5-6c27-4875-840f-191b5f7f6a1d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.193312 Jun 21 10:47:39.889627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 467/910] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:39 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:47:40.914374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:40.915346 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:40.924495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:40.924945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:40.925746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:40.926216 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:40.944888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:41.371904 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:41.381662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:41.383205 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:41.384399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-41d0f0af-a6dc-4058-aecd-4011e442113e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.477003 Jun 21 10:47:41.384967 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 444/911] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:40 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:42.402561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:42.403217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:42.410934 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:42.411383 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:42.412172 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:42.412607 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:42.557637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:42.567751 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:42.569656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:42.570517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0ae628f5-39ef-4d31-8c2e-6b65df2efc07 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.172170 Jun 21 10:47:42.571369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 468/912] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:42 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:43.593931 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:43.594579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:43.602086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:43.602572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:43.603332 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:43.603758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:43.746033 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:43.756984 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:43.758826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:43.760286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-71e81c48-54e1-49fd-9991-0a84af916e75 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.172660 Jun 21 10:47:43.760822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 445/913] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:43 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:44.780206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:44.780819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:44.788152 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:44.788603 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:44.789760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:44.789886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:44.936683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:44.946158 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:44.948012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:44.949195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c10c29f9-1aad-4e63-be76-ac510270d219 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.173938 Jun 21 10:47:44.950120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 469/914] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:44 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:45.968446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:45.969083 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:45.976645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:45.977087 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:45.977899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:45.978350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:46.125202 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:46.134999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:46.136560 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:46.137810 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-327157a2-8e90-4cf0-9d2c-74666219dd46 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.173359 Jun 21 10:47:46.138496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 446/915] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:45 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:47.157413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:47.158673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:47.165570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:47.166023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:47.166872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:47.167308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:47.332123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:47.349906 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:47.353201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:47.354871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-346002ba-815b-477e-8ddb-b18ff3c59444 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.201675 Jun 21 10:47:47.355602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 470/916] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:47 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:48.379399 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:48.379990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:48.386766 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:48.387190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:48.387968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:48.388373 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:48.484272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571365755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-396547085", "security_groups": [{"name": "tempest-secgroup-smoke-21708833"}], "block_device_mapping_v2": [{"uuid": "705cf4ec-62b4-45b6-82d2-9a42bb105feb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "093916b0-2043-4c85-8617-0988f1b9e421"}]}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:48.533493 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:48.542678 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:48.544166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:48.545326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d201b604-4d38-4df9-a596-945da40b740f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.170597 Jun 21 10:47:48.545899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 447/917] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:48 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:48.617584 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] validate_networks() for [('093916b0-2043-4c85-8617-0988f1b9e421', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:47:49.070085 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:47:49.070642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:47:49.071121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:47:49.071565 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:47:49.072397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:47:49.088712 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:49.089196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:49.090101 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:49.090586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:49.108332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:47:49.112910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Getting quotas for user f9eaebabd54a45a29f262b67fe1c433b and project 25adacdcc5b44375b112a93f8623802c. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:47:49.178184 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:47:49.181267 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='705cf4ec-62b4-45b6-82d2-9a42bb105feb',volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:47:49.325323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ab71c606-5796-4cb3-bf34-f378e30a39a6 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.844870 Jun 21 10:47:49.326039 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 471/918] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:47:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 10:47:49.336752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-050ac193-93a1-4aad-aa87-455aa45c5b3c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:49.337721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-050ac193-93a1-4aad-aa87-455aa45c5b3c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:49.401096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-050ac193-93a1-4aad-aa87-455aa45c5b3c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:49.408341 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-050ac193-93a1-4aad-aa87-455aa45c5b3c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1093 microversion: 2.1 time: 0.075530 Jun 21 10:47:49.409220 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 448/919] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:49 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:49.564458 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:49.565840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:49.574358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:49.574799 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:49.575718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:49.576066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:49.744588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:49.754207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:49.755526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:49.756726 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-29aecee9-720e-464c-8c8d-e16936813e23 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.196853 Jun 21 10:47:49.757290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 472/920] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:49 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:50.425637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:50.426318 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:50.433961 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:50.434444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:50.435350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:50.435837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:50.509638 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:50.520648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0506f4f6-eeb1-499d-ae6d-06becefe7a10 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1191 microversion: 2.1 time: 0.099000 Jun 21 10:47:50.521403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 449/921] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:50 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:50.775779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:50.776408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:50.786470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:50.787286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:50.790861 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:50.791352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:50.853903 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-8972ca65-e443-4390-ad67-dd5754528e8b req-52c40c14-a1f7-40aa-af7d-623d75debe62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "name": "network-vif-plugged", "status": "completed", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:50.863041 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8972ca65-e443-4390-ad67-dd5754528e8b req-52c40c14-a1f7-40aa-af7d-623d75debe62 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:50.863573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-8972ca65-e443-4390-ad67-dd5754528e8b req-52c40c14-a1f7-40aa-af7d-623d75debe62 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:50.878441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-8972ca65-e443-4390-ad67-dd5754528e8b req-52c40c14-a1f7-40aa-af7d-623d75debe62 service nova] Creating event network-vif-plugged:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:47:50.885885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-8972ca65-e443-4390-ad67-dd5754528e8b req-52c40c14-a1f7-40aa-af7d-623d75debe62 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136694 Jun 21 10:47:50.886929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 473/922] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:47:51.083884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:51.092882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:51.094747 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:51.096450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-288bc301-c7c6-42cb-a610-7079d8e14454 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.324752 Jun 21 10:47:51.097210 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 450/923] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:50 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:51.543345 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:51.544519 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:51.555636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:51.556792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:51.557987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:51.558963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:51.780623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:51.798835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c6d226e5-35d9-4ab3-8ed5-5156f78fbd0d tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1275 microversion: 2.1 time: 0.262923 Jun 21 10:47:51.800036 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 474/924] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:51 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:52.117254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:52.118034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:52.124933 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:52.125375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:52.126174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:52.126671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:52.331040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:52.341337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:52.342881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:52.344098 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9a64dfb4-0926-46e5-b8cb-9680cbd8b9b1 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.230843 Jun 21 10:47:52.344869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 451/925] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:52 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:52.825569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:52.826754 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:52.833182 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:52.833636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:52.834441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:52.835090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:52.987711 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:52.996803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8f9f8b90-46e7-4480-96ff-8b1a6c292e6e tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.176216 Jun 21 10:47:53.002094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 475/926] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:52 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:53.009572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-36198b79-acbe-4762-bf0c-26e2f607bc60 req-5aaf6342-6a07-4dcb-8124-9cfcb42c8cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e5c241-e592-4cc6-97f6-a19796815ed6", "tag": "63aec611-e850-4617-b3a8-84ea12cd5966"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:47:53.018663 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-36198b79-acbe-4762-bf0c-26e2f607bc60 req-5aaf6342-6a07-4dcb-8124-9cfcb42c8cf7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:53.019156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-36198b79-acbe-4762-bf0c-26e2f607bc60 req-5aaf6342-6a07-4dcb-8124-9cfcb42c8cf7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:53.031365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-36198b79-acbe-4762-bf0c-26e2f607bc60 req-5aaf6342-6a07-4dcb-8124-9cfcb42c8cf7 service nova] Creating event network-changed:63aec611-e850-4617-b3a8-84ea12cd5966 for instance 37e5c241-e592-4cc6-97f6-a19796815ed6 on hv-cinder-83697 Jun 21 10:47:53.036833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-36198b79-acbe-4762-bf0c-26e2f607bc60 req-5aaf6342-6a07-4dcb-8124-9cfcb42c8cf7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031083 Jun 21 10:47:53.038408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 452/927] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:47:53.364416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:53.365028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:53.372759 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:53.373197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:53.374249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:53.374881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:53.544548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:53.554521 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:53.556043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:53.557213 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4096ba08-ec45-44ce-ab62-b0aad9cd7ebd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1807 microversion: 2.20 time: 0.197572 Jun 21 10:47:53.557958 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 476/928] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:53 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:47:54.017000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:54.018858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:54.026043 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:54.026879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:54.027735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:54.028178 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:54.173391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:54.181498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f83f8777-e350-4799-b077-96eaaa120cc5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.169873 Jun 21 10:47:54.182084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 453/929] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:54 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:54.575940 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:54.576563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:54.583872 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:54.584344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:54.585123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:54.585561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:54.722503 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:54.731871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:54.733371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:54.734587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b300b8da-0494-4dea-bb42-72a3a6704b8b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1794 microversion: 2.20 time: 0.162979 Jun 21 10:47:54.735143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 477/930] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:47:54 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:47:55.199633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:55.200316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:55.209370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:55.209907 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:55.211347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:55.211347 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:55.427917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:55.436665 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8c264f75-47b8-4d04-8546-6e04cc06f547 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.241553 Jun 21 10:47:55.437271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 454/931] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:55 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:56.454198 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:56.454866 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:56.462089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:56.462529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:56.463333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:56.463770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:56.629703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:56.637944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a1e15cc1-4748-42a2-8689-038bc7934b8a tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.187575 Jun 21 10:47:56.638562 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 478/932] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:56 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:57.655056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:57.655696 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:57.657729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=36 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:57.663220 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:57.663664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:57.664453 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:57.664924 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:57.814832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:57.823525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9b50cdb0-6165-48e0-be2c-4e7c9b3c23ae tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.172609 Jun 21 10:47:57.824112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 455/933] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:57 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:47:58.841099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:47:58.841701 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:47:58.850413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:58.850857 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:58.851654 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:47:58.852082 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:47:59.010362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:47:59.021853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f8a5a61e-4a6b-4373-9102-5460cdf91fbc tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.184697 Jun 21 10:47:59.022449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 479/934] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:47:58 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:00.039898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:00.040525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:00.042957 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:00.049588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:00.050103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:00.050890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:00.051372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:00.193918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:00.202554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-840b9f00-2b90-4d5e-8982-6823ca91c9f3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.167334 Jun 21 10:48:00.203133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 456/935] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:00 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:01.220790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:01.221420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:01.224368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:01.225210 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:01.233191 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:01.233721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:01.234664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:01.235469 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:01.394883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:01.404056 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ac4e7ed3-105a-48f4-9f74-3ed07bdaaa02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.187564 Jun 21 10:48:01.404873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 480/936] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:01 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:02.424790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:02.425438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:02.434402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:02.434885 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:02.435877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:02.436516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:02.581673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:02.590352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-30e06241-b530-4c63-9193-50e0ba2e8b13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.171390 Jun 21 10:48:02.590926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 457/937] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:02 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:03.608149 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:03.608818 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:03.616466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:03.616887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:03.617735 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:03.618209 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:03.767068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:03.775526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7c3b545d-c125-4a81-aedd-025842b558d7 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.171389 Jun 21 10:48:03.776105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 481/938] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:03 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:04.792564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:04.793185 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:04.800407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:04.800830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:04.801740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:04.802659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:04.851168 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-cf7a7410-0766-46d2-9aa6-a677da005aa6 req-b067d7b3-e359-4604-b9f7-d5e60b8879c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5c241-e592-4cc6-97f6-a19796815ed6", "name": "network-vif-plugged", "status": "completed", "tag": "63aec611-e850-4617-b3a8-84ea12cd5966"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:04.859953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cf7a7410-0766-46d2-9aa6-a677da005aa6 req-b067d7b3-e359-4604-b9f7-d5e60b8879c6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:04.860410 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-cf7a7410-0766-46d2-9aa6-a677da005aa6 req-b067d7b3-e359-4604-b9f7-d5e60b8879c6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:04.874038 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-cf7a7410-0766-46d2-9aa6-a677da005aa6 req-b067d7b3-e359-4604-b9f7-d5e60b8879c6 service nova] Creating event network-vif-plugged:63aec611-e850-4617-b3a8-84ea12cd5966 for instance 37e5c241-e592-4cc6-97f6-a19796815ed6 on hv-cinder-83697 Jun 21 10:48:04.879037 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-cf7a7410-0766-46d2-9aa6-a677da005aa6 req-b067d7b3-e359-4604-b9f7-d5e60b8879c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Jun 21 10:48:04.880035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 482/939] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:48:04.948065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:04.955806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-68fcc6d7-c552-4fa0-8069-bbabb584d243 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.167198 Jun 21 10:48:04.956387 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 458/940] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:04 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:05.974405 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:05.975010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:05.981793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:05.982282 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:05.983059 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:05.983498 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:05.986308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=98 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:06.131419 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:06.141826 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5065a10b-1ee2-4713-afca-f3d1d47abf02 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1263 microversion: 2.1 time: 0.172386 Jun 21 10:48:06.142438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 483/941] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:05 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:07.161102 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:07.162430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:07.169417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:07.169847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:07.170698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:07.171131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:07.317376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:07.326767 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-601a4637-b9e3-4ec1-9326-fb0ffe2ffed8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1450 microversion: 2.1 time: 0.169588 Jun 21 10:48:07.327351 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 459/942] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:07 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:07.342899 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:07.343513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:07.345805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:07.351908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:07.352352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:07.354802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:07.354802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:07.502236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:07.510419 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-daa0c320-a874-4e81-acb2-04303a3fcc52 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1450 microversion: 2.1 time: 0.171306 Jun 21 10:48:07.511035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 484/943] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:07 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:09.718154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-97aac337-fd88-4b86-843c-ee51cc2196b9 req-727966c7-1ab8-4e8f-bd77-2722feeb3eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e5c241-e592-4cc6-97f6-a19796815ed6", "tag": "63aec611-e850-4617-b3a8-84ea12cd5966"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:09.725652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-97aac337-fd88-4b86-843c-ee51cc2196b9 req-727966c7-1ab8-4e8f-bd77-2722feeb3eb7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:09.726228 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-97aac337-fd88-4b86-843c-ee51cc2196b9 req-727966c7-1ab8-4e8f-bd77-2722feeb3eb7 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:09.741156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-97aac337-fd88-4b86-843c-ee51cc2196b9 req-727966c7-1ab8-4e8f-bd77-2722feeb3eb7 service nova] Creating event network-changed:63aec611-e850-4617-b3a8-84ea12cd5966 for instance 37e5c241-e592-4cc6-97f6-a19796815ed6 on hv-cinder-83697 Jun 21 10:48:09.746866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-97aac337-fd88-4b86-843c-ee51cc2196b9 req-727966c7-1ab8-4e8f-bd77-2722feeb3eb7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096904 Jun 21 10:48:09.747602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 460/944] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:48:37.604400 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:37.605072 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:37.607199 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:37.607859 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=11 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:37.614000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:37.614479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:37.615268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:37.615707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:37.640066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c48bc030-b65d-45e5-a49b-0289eba77c5c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039573 Jun 21 10:48:37.640639 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 485/945] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:48:37 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:48:39.026634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=11 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:39.027382 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=84 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:39.032041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee0734a6-e5b6-45e2-87cb-5859280189ec"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:39.033173 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:39.041323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:39.041875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:39.043025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:39.043443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:39.375826 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d6bf6ccc-bded-4a82-ad2f-2e07b1ebd62a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350555 Jun 21 10:48:39.376470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 461/946] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:48:39 2022] POST /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:48:46.926399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a8c8230d-c066-47c4-b291-16132ece10d1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: .version_select at 0x7f8a3a67c3a0>, body: {"keypair": {"name": "tempest-keypair-671415883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+w3iU94x9MYj3hvPhy/viMkyqpF+gdIGn7vmVX5+UcDWuCGmp5RSfFd0sziP0gKw6ecojBk0wimz6Sa+SmXzfjS5N9fkuSNQiAS95w5eHZVXP3vqs/LFQag6rzZybzIg=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:46.941739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-a8c8230d-c066-47c4-b291-16132ece10d1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:48:46.945856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-a8c8230d-c066-47c4-b291-16132ece10d1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:48:46.971115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a8c8230d-c066-47c4-b291-16132ece10d1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048632 Jun 21 10:48:46.971642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 486/947] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:48:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:48:48.412449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-240824013", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e610a6-095a-475b-879f-4c63a030f200"}], "security_groups": [{"name": "tempest-securitygroup--1881423202"}], "key_name": "tempest-keypair-671415883", "user_data": "}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:48.536844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] validate_networks() for [('d4e610a6-095a-475b-879f-4c63a030f200', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:48:49.019211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:48:49.019632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:48:49.020101 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:48:49.020739 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:48:49.021372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:48:49.030971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:49.031408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:49.032195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:49.032620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:49.051447 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:48:49.057152 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:48:49.071998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:48:49.074688 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:48:49.131330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-33d3ba95-d572-4427-b5c7-98981d222195 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723284 Jun 21 10:48:49.137536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 462/948] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:48:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:48:49.143696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5ca2d990-0e1d-4d11-b703-5c8ff4d6f344 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:49.144350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5ca2d990-0e1d-4d11-b703-5c8ff4d6f344 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:49.146515 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:49.211061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5ca2d990-0e1d-4d11-b703-5c8ff4d6f344 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:49.218272 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5ca2d990-0e1d-4d11-b703-5c8ff4d6f344 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1240 microversion: 2.1 time: 0.079005 Jun 21 10:48:49.219306 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 487/949] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:49 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:50.237801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:50.238493 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:50.247661 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:50.248435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:50.249483 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:50.250147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:50.349572 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:50.362606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2786f496-5623-4bbd-bc3b-b01396d7305f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1310 microversion: 2.1 time: 0.128936 Jun 21 10:48:50.363824 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 463/950] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:50 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1310 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:51.390275 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:51.390899 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:51.404070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:51.404070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:51.404070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:51.404929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:51.562432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:51.572745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dea1dde7-20e5-495d-aa8a-6345d1067efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.187038 Jun 21 10:48:51.573316 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 488/951] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:51 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:52.159619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-a13db524-fe2c-46aa-a06e-ea9c86532b48 req-915e9105-a199-4a56-adc8-25844fc1fcec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb7b0dd-9905-4ca1-8a75-cad097411c7f", "tag": "0f0e716f-b88c-40a5-98a5-3c840e543b09"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:52.176395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a13db524-fe2c-46aa-a06e-ea9c86532b48 req-915e9105-a199-4a56-adc8-25844fc1fcec service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:52.180408 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-a13db524-fe2c-46aa-a06e-ea9c86532b48 req-915e9105-a199-4a56-adc8-25844fc1fcec service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:52.199319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-a13db524-fe2c-46aa-a06e-ea9c86532b48 req-915e9105-a199-4a56-adc8-25844fc1fcec service nova] Creating event network-changed:0f0e716f-b88c-40a5-98a5-3c840e543b09 for instance beb7b0dd-9905-4ca1-8a75-cad097411c7f on hv-cinder-83697 Jun 21 10:48:52.205796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-a13db524-fe2c-46aa-a06e-ea9c86532b48 req-915e9105-a199-4a56-adc8-25844fc1fcec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049817 Jun 21 10:48:52.209816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 464/952] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:48:52.590325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:52.590944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:52.598141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:52.598514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:52.599579 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:52.600160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:52.741722 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:52.749779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-865f95b7-5ab2-42bb-b2d8-cd1876ff780e tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.163397 Jun 21 10:48:52.750373 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 489/953] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:52 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:53.768342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:53.769277 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:53.776482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:53.776929 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:53.777706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:53.778147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:53.922172 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:53.930755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9fc0ac24-fecb-4789-8ac6-667172beb599 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.166825 Jun 21 10:48:53.931298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 465/954] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:53 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:54.952948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:54.953586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:54.960618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:54.961075 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:54.961844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:54.962324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:55.259333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:55.265817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9d1ab8a6-e254-4a17-9f4f-f3faab9a5e82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.316796 Jun 21 10:48:55.266427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 490/955] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:54 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:56.284226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:56.284896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:56.292293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:56.292749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:56.293534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:56.293979 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:56.444707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:56.454543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5683cae0-b227-4f41-bfe5-3b6a11cc57b1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.174075 Jun 21 10:48:56.455248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 466/956] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:56 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:57.473294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:57.473884 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:57.481266 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:57.481717 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:57.482506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:57.482945 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:57.627144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:57.635266 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a51eee1f-fe0f-4244-b6e0-b26890b8c53a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.165985 Jun 21 10:48:57.635805 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 491/957] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:57 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:58.651851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:58.652467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:58.659667 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:58.660218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:58.660978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:58.661417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:58.797530 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:58.805564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-862d43c1-0df6-4a33-887b-d5fd36222edb tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.157664 Jun 21 10:48:58.806343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 467/958] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:58 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:48:59.071331 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-be017994-b197-4936-8d2a-83be3edd4ab9 req-5b39b2fa-da09-4840-acd2-4a211426328a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb7b0dd-9905-4ca1-8a75-cad097411c7f", "name": "network-vif-plugged", "status": "completed", "tag": "0f0e716f-b88c-40a5-98a5-3c840e543b09"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:48:59.080737 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-be017994-b197-4936-8d2a-83be3edd4ab9 req-5b39b2fa-da09-4840-acd2-4a211426328a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:59.081183 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-be017994-b197-4936-8d2a-83be3edd4ab9 req-5b39b2fa-da09-4840-acd2-4a211426328a service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:59.093045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-be017994-b197-4936-8d2a-83be3edd4ab9 req-5b39b2fa-da09-4840-acd2-4a211426328a service nova] Creating event network-vif-plugged:0f0e716f-b88c-40a5-98a5-3c840e543b09 for instance beb7b0dd-9905-4ca1-8a75-cad097411c7f on hv-cinder-83697 Jun 21 10:48:59.098305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-be017994-b197-4936-8d2a-83be3edd4ab9 req-5b39b2fa-da09-4840-acd2-4a211426328a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Jun 21 10:48:59.098915 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 492/959] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:48:59.824409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:48:59.825029 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:48:59.827015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:59.827672 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:59.834786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:59.835235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:59.836008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:48:59.836442 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:48:59.981587 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:48:59.989158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3bbafa7c-b740-43ac-9266-ec98bcf38fe6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.169161 Jun 21 10:48:59.989715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 468/960] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:48:59 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:49:01.005040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:01.011461 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:01.012427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:01.021542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:01.022124 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:01.023193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:01.023779 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:01.169836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:01.177318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-23ec6f03-3a9c-46d8-9150-880b5b9b81c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1366 microversion: 2.1 time: 0.173614 Jun 21 10:49:01.177874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 493/961] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:49:01 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:49:02.198280 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:02.198948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:02.205871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:02.206352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:02.207133 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:02.207573 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:02.350588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:02.360445 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bbe626c9-17bb-4189-836c-7c5a7e816cab tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1556 microversion: 2.1 time: 0.168319 Jun 21 10:49:02.361168 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 469/962] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:49:02 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:49:02.377454 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:02.377985 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:02.386529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:02.387095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:02.388274 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:02.388972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:02.476320 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-158494eb-ee47-4203-a29a-042968659b82 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102747 Jun 21 10:49:02.476907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 494/963] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:49:02 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:49:03.465760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-79eae4e5-b88e-440a-886f-9a2dc4b60fa5 req-306ab58d-6638-4117-ae7d-1773a4cb412f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb7b0dd-9905-4ca1-8a75-cad097411c7f", "tag": "0f0e716f-b88c-40a5-98a5-3c840e543b09"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:03.475119 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-79eae4e5-b88e-440a-886f-9a2dc4b60fa5 req-306ab58d-6638-4117-ae7d-1773a4cb412f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:03.475558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-79eae4e5-b88e-440a-886f-9a2dc4b60fa5 req-306ab58d-6638-4117-ae7d-1773a4cb412f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:03.486975 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-79eae4e5-b88e-440a-886f-9a2dc4b60fa5 req-306ab58d-6638-4117-ae7d-1773a4cb412f service nova] Creating event network-changed:0f0e716f-b88c-40a5-98a5-3c840e543b09 for instance beb7b0dd-9905-4ca1-8a75-cad097411c7f on hv-cinder-83697 Jun 21 10:49:03.492215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-79eae4e5-b88e-440a-886f-9a2dc4b60fa5 req-306ab58d-6638-4117-ae7d-1773a4cb412f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030374 Jun 21 10:49:03.492996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 470/964] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:49:11.132582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:11.133220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:11.134931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:11.140623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.141061 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.141827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.142290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.172147 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dc8e580e-25e3-457f-b351-1abd16cbe3a5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments/696bd78a-3de0-4281-b4b6-e5d808bb11c5" status: 200 len: 194 microversion: 2.20 time: 0.044281 Jun 21 10:49:11.172723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 495/965] 10.222.0.43 () {60 vars in 1453 bytes} [Tue Jun 21 10:49:11 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments/696bd78a-3de0-4281-b4b6-e5d808bb11c5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:49:11.251801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:11.252373 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:11.255054 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:11.260984 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.261579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.262307 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.262743 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.267651 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:11.351204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lazy-loading 'services' on Instance uuid 21bd820c-b0da-4004-abbc-216348f04c3f {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:49:11.432236 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3aa00fa4-feac-43e7-b1af-823f8e5607d2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments/696bd78a-3de0-4281-b4b6-e5d808bb11c5" status: 202 len: 0 microversion: 2.20 time: 0.184618 Jun 21 10:49:11.433237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 471/966] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Jun 21 10:49:11 2022] DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments/696bd78a-3de0-4281-b4b6-e5d808bb11c5 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:49:11.444136 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:11.445098 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:11.453022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.453529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.454333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:11.455638 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:11.491132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7063e5ee-9eb5-4e65-bc10-ae1b655d2993 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051468 Jun 21 10:49:11.491697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 496/967] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 21 10:49:11 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:49:12.504222 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:12.505277 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:12.513788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.514313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.515110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.515535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.548752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0f2f8d5a-8a5a-4668-a398-14d326395877 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049283 Jun 21 10:49:12.549519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 472/968] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 21 10:49:12 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:49:12.609358 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:12.609970 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:12.616435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.616876 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.617642 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.618099 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.646140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:49:12.730203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b33e96c5-06af-4184-8537-1ba5dd583f38 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 204 len: 0 microversion: 2.20 time: 0.124561 Jun 21 10:49:12.731636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 497/969] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 21 10:49:12 2022] DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:49:12.739786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:12.740388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:12.747406 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.747849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.748607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:12.749035 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:12.888115 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:12.896796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:12.898336 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:12.899525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fb3fd270-1274-4cfb-ab75-490aa0bb7af2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.163625 Jun 21 10:49:12.900093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 473/970] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:12 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:13.922863 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:13.923452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:13.930441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:13.930861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:13.931672 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:13.932102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:14.067165 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:14.076346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:14.077864 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:14.079071 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-355ce3d9-31b3-415e-a42d-f99e4a284e2b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.161907 Jun 21 10:49:14.079631 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 498/971] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:13 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:15.099785 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:15.100402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:15.106822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:15.107427 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:15.108079 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:15.108513 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:15.349567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:15.359304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:15.360799 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:15.361988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-87cd5a9a-1325-467f-95a7-a26c567f3acf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1722 microversion: 2.20 time: 0.266783 Jun 21 10:49:15.362580 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 474/972] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:15 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:15.797546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5646111f-7516-4ab4-a54a-eaa074fccf49 req-a0e650a9-629c-4609-969d-87fc5d8395be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd820c-b0da-4004-abbc-216348f04c3f", "name": "network-vif-deleted", "tag": "54d6a253-59aa-4331-8bd7-266ce0a3fdc9"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:15.808252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5646111f-7516-4ab4-a54a-eaa074fccf49 req-a0e650a9-629c-4609-969d-87fc5d8395be service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:15.808704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5646111f-7516-4ab4-a54a-eaa074fccf49 req-a0e650a9-629c-4609-969d-87fc5d8395be service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:15.823484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5646111f-7516-4ab4-a54a-eaa074fccf49 req-a0e650a9-629c-4609-969d-87fc5d8395be service nova] Creating event network-vif-deleted:54d6a253-59aa-4331-8bd7-266ce0a3fdc9 for instance 21bd820c-b0da-4004-abbc-216348f04c3f on hv-cinder-83697 Jun 21 10:49:15.829123 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5646111f-7516-4ab4-a54a-eaa074fccf49 req-a0e650a9-629c-4609-969d-87fc5d8395be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035677 Jun 21 10:49:15.829789 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 499/973] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:49:16.381082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:16.381695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:16.389132 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:16.389586 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:16.390564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:16.390983 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:16.429943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:16.431478 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:16.432028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lazy-loading 'fault' on Instance uuid 21bd820c-b0da-4004-abbc-216348f04c3f {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:49:16.483426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:16.491516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:16.493044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:16.494234 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-97ef17f9-5a63-4718-9228-d535be5c7a7f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 200 len: 1370 microversion: 2.20 time: 0.117280 Jun 21 10:49:16.494810 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 475/974] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:16 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:17.512628 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:17.513947 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:17.520891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:17.521333 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:17.522060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:17.522532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:17.536378 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f HTTP/1.1 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:49:17.537933 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:49:17.539580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '21bd820c-b0da-4004-abbc-216348f04c3f'} Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:49:17.540465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:49:17.542033 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:49:17.543569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:49:17.543569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b15b5f08-0662-42e9-a770-324705329f92 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 404 len: 111 microversion: 2.20 time: 0.031049 Jun 21 10:49:17.543569 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 500/975] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:17 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:49:17.548805 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b543031b-ab5e-43a6-9e90-2b7889c2ec0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '.version_select at 0x7f8a366b0820>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:17.571237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b543031b-ab5e-43a6-9e90-2b7889c2ec0a tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377941506" status: 204 len: 0 microversion: 2.20 time: 0.026494 Jun 21 10:49:17.572197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 476/976] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Jun 21 10:49:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377941506 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:49:18.252778 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1376162b-5f03-4ae6-95ad-bdfd01b5e858 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: .version_select at 0x7f8a35cccdc0>, body: {"keypair": {"name": "tempest-keypair-1875104143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyxL4DtJ9s3utmFcAgOPAbLwL+NmlOCrrLCZg2wbJi2ItCXxpHm5nPzTnm9l6oqG/D1fh4gpt4HBVecWdQOAx/jRzbOkgXaOT5a48vcQp/9q/Whj9sc6flCnh/hljONPQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:18.267471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1376162b-5f03-4ae6-95ad-bdfd01b5e858 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for project 136181b906064188b6d06ca200fb9037. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:49:18.271643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-1376162b-5f03-4ae6-95ad-bdfd01b5e858 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for user 6a75b9c7a5bc4959b27d5c5b87b9c1cd and project 136181b906064188b6d06ca200fb9037. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:49:18.296387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1376162b-5f03-4ae6-95ad-bdfd01b5e858 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047463 Jun 21 10:49:18.296974 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 501/977] 10.222.0.43 () {62 vars in 1199 bytes} [Tue Jun 21 10:49:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 10:49:19.664355 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1936183893", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b0b5a4d-9565-4660-b0b8-572ddf3eb6ed"}], "security_groups": [{"name": "tempest-securitygroup--1687591466"}], "key_name": "tempest-keypair-1875104143", "user_data": "}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:19.773124 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] validate_networks() for [('8b0b5a4d-9565-4660-b0b8-572ddf3eb6ed', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:49:20.168204 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:49:20.168820 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:49:20.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:49:20.169886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:49:20.170890 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:49:20.180452 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:20.180903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:20.181692 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:20.182169 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:20.199479 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for project 136181b906064188b6d06ca200fb9037. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:49:20.203801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Getting quotas for user 6a75b9c7a5bc4959b27d5c5b87b9c1cd and project 136181b906064188b6d06ca200fb9037. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:49:20.215435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:49:20.217787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:49:20.270446 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6a137128-d894-4d7d-8708-28ecea4bf534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.610839 Jun 21 10:49:20.271140 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 477/978] 10.222.0.43 () {62 vars in 1187 bytes} [Tue Jun 21 10:49:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 10:49:20.283416 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:20.284145 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:20.347407 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:20.355538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:20.357046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:20.358258 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9f60d2c8-6232-40c3-bd8a-8c545e80d215 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1282 microversion: 2.20 time: 0.080349 Jun 21 10:49:20.358816 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 502/979] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:20 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:21.377514 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:21.378121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:21.385094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:21.385545 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:21.386348 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:21.386779 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:21.463540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:21.477954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:21.480286 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:21.481829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9b079c07-9b56-4151-90cf-a807af23a702 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1334 microversion: 2.20 time: 0.109193 Jun 21 10:49:21.482735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 478/980] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:21 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:22.501380 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:22.502494 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:22.510170 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:22.510829 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:22.512027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:22.512472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:22.515529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:22.673939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:22.682829 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:22.684317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:22.685492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-49b4998c-ceb8-4f3b-bb0b-a0b1a6d8e789 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.188606 Jun 21 10:49:22.686232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 503/981] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:22 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:23.404487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-1910a244-5837-45b8-8afa-36364f762e5c req-25493125-362d-4643-bf5e-bc164dfa41d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:23.417059 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1910a244-5837-45b8-8afa-36364f762e5c req-25493125-362d-4643-bf5e-bc164dfa41d6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:23.417538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-1910a244-5837-45b8-8afa-36364f762e5c req-25493125-362d-4643-bf5e-bc164dfa41d6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:23.429869 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-1910a244-5837-45b8-8afa-36364f762e5c req-25493125-362d-4643-bf5e-bc164dfa41d6 service nova] Creating event network-changed:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:49:23.436677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-1910a244-5837-45b8-8afa-36364f762e5c req-25493125-362d-4643-bf5e-bc164dfa41d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035856 Jun 21 10:49:23.437325 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 479/982] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:49:23.707911 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:23.709040 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:23.720043 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:23.720831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:23.722223 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:23.723009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:23.890141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:23.898465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:23.899970 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:23.901132 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc63473c-576f-4da1-bc16-fc09ac05743f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.200794 Jun 21 10:49:23.901690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 504/983] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:23 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:24.926047 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:24.927565 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:24.937569 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:24.938017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:24.938823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:24.939261 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:25.093036 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:25.102518 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:25.103998 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:25.105225 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-64e64dce-41df-4beb-8cc8-076d31696ee6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.187478 Jun 21 10:49:25.105782 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 480/984] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:24 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:26.126844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:26.127465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:26.137257 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:26.137769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:26.138910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:26.139596 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:26.508327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:26.516760 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:26.518856 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:26.520058 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ddbff987-573a-417a-a75f-f5fe4b2d4ed0 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.399382 Jun 21 10:49:26.520613 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 505/985] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:26 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:27.538718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:27.539386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:27.546430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:27.546910 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:27.547694 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:27.548200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:27.686536 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:27.699123 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:27.701417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:27.702785 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2916274f-00f6-4c5b-890a-5fbadbd8d534 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.168195 Jun 21 10:49:27.703344 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 481/986] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:27 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:28.721385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:28.722012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:28.729107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:28.729565 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:28.730376 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:28.730816 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:28.869221 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:28.877689 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:28.879225 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:28.880338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9bff74d9-2aa3-40d3-a990-997e2015acb6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.163050 Jun 21 10:49:28.880892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 506/987] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:28 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:29.230221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-5e27d1e5-876c-46c5-bfd5-2040ac65e245 req-98be323b-f430-437f-b255-411f64bb2c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "name": "network-vif-plugged", "status": "completed", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:29.239103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5e27d1e5-876c-46c5-bfd5-2040ac65e245 req-98be323b-f430-437f-b255-411f64bb2c71 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:29.239525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5e27d1e5-876c-46c5-bfd5-2040ac65e245 req-98be323b-f430-437f-b255-411f64bb2c71 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:29.253718 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-5e27d1e5-876c-46c5-bfd5-2040ac65e245 req-98be323b-f430-437f-b255-411f64bb2c71 service nova] Creating event network-vif-plugged:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:49:29.259022 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-5e27d1e5-876c-46c5-bfd5-2040ac65e245 req-98be323b-f430-437f-b255-411f64bb2c71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 Jun 21 10:49:29.259943 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 482/988] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:49:29.904006 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:29.904579 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:29.914506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:29.914997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:29.916233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:29.916875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:30.061202 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:30.069305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:30.070820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:30.072298 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b7eb9994-155f-4dec-a252-4e94cc76c272 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.174253 Jun 21 10:49:30.072847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 507/989] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:29 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:31.088839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:31.089817 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:31.095898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:31.096727 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:31.106186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:31.106740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:31.107681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:31.108191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:31.252796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:31.260850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:31.262374 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:31.263513 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f0fd4013-f44c-42f8-af27-6756aa55e744 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1408 microversion: 2.20 time: 0.175983 Jun 21 10:49:31.264073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 483/990] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:31 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:32.281069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:32.281681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:32.283588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:32.290203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:32.290656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:32.291432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:32.291892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:32.428904 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:32.437134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:32.438746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:49:32.439916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cffb8dfa-8ab5-4a60-8f32-d680454cabbe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1599 microversion: 2.20 time: 0.162812 Jun 21 10:49:32.440493 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 508/991] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:49:32 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:49:32.458195 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:49:32.458757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:49:32.465601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:32.466071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:32.466843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:32.467279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:32.556371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6f66fbdc-d5ad-43a7-8695-32a91a427d59 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101948 Jun 21 10:49:32.557179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 484/992] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Jun 21 10:49:32 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:49:33.519641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-3f424b2a-1bad-490d-b45b-b81f12264267 req-36b57aa5-0b19-4977-8fcd-a4fb53c1286f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:49:33.528795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3f424b2a-1bad-490d-b45b-b81f12264267 req-36b57aa5-0b19-4977-8fcd-a4fb53c1286f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:49:33.529239 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-3f424b2a-1bad-490d-b45b-b81f12264267 req-36b57aa5-0b19-4977-8fcd-a4fb53c1286f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:49:33.540949 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-3f424b2a-1bad-490d-b45b-b81f12264267 req-36b57aa5-0b19-4977-8fcd-a4fb53c1286f service nova] Creating event network-changed:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:49:33.546404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-3f424b2a-1bad-490d-b45b-b81f12264267 req-36b57aa5-0b19-4977-8fcd-a4fb53c1286f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030426 Jun 21 10:49:33.547294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 509/993] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:10.419365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:10.420632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:10.424535 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-86402056-21dd-42c5-ae1b-b75200ce962b req-86fdd5d9-43f3-4e07-8334-0fb3f2b08e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e5c241-e592-4cc6-97f6-a19796815ed6", "tag": "63aec611-e850-4617-b3a8-84ea12cd5966"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:10.425926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:10.426538 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:10.429283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:10.430686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=37 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:10.436559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:10.437528 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:10.437976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-86402056-21dd-42c5-ae1b-b75200ce962b req-86fdd5d9-43f3-4e07-8334-0fb3f2b08e57 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:10.438523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-86402056-21dd-42c5-ae1b-b75200ce962b req-86fdd5d9-43f3-4e07-8334-0fb3f2b08e57 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:10.439677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:10.440221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:10.453186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-86402056-21dd-42c5-ae1b-b75200ce962b req-86fdd5d9-43f3-4e07-8334-0fb3f2b08e57 service nova] Creating event network-changed:63aec611-e850-4617-b3a8-84ea12cd5966 for instance 37e5c241-e592-4cc6-97f6-a19796815ed6 on hv-cinder-83697 Jun 21 10:50:10.458662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-86402056-21dd-42c5-ae1b-b75200ce962b req-86fdd5d9-43f3-4e07-8334-0fb3f2b08e57 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038684 Jun 21 10:50:10.459297 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 510/994] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:10.471964 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:50:10.557444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-49ea8c22-879d-4e00-89b6-cb80b5d6714b tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "DELETE /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 204 len: 0 microversion: 2.1 time: 0.139508 Jun 21 10:50:10.558963 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 485/995] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:50:10 2022] DELETE /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:50:10.568887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:10.569713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:10.577115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:10.577561 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:10.578391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:10.578836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:10.722114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:10.729917 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bcab41b7-beb6-4275-a588-eea37c213f13 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1575 microversion: 2.1 time: 0.165867 Jun 21 10:50:10.730510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 511/996] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:10 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:11.748364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:11.749048 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:11.757304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:11.757770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:11.758996 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:11.759294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:11.966098 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:11.975552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a56d3732-9ae2-4c4f-923f-611cf43254c3 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1575 microversion: 2.1 time: 0.231631 Jun 21 10:50:11.976200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 486/997] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:11 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:12.995330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:12.996014 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:13.005394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:13.005848 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:13.006664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:13.007362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:13.154231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-42a62535-7ee6-4f56-b00b-efbdf6ddcf73 req-324ca815-020f-4351-a3b1-c860e3be42c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5c241-e592-4cc6-97f6-a19796815ed6", "name": "network-vif-deleted", "tag": "63aec611-e850-4617-b3a8-84ea12cd5966"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:13.156813 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:13.165420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-42a62535-7ee6-4f56-b00b-efbdf6ddcf73 req-324ca815-020f-4351-a3b1-c860e3be42c6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:13.165730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c4af1f8d-1e94-465a-aa5b-5634611ec64f tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 200 len: 1456 microversion: 2.1 time: 0.176178 Jun 21 10:50:13.175439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-42a62535-7ee6-4f56-b00b-efbdf6ddcf73 req-324ca815-020f-4351-a3b1-c860e3be42c6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:13.175659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 512/998] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:12 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 1456 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:13.179549 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-42a62535-7ee6-4f56-b00b-efbdf6ddcf73 req-324ca815-020f-4351-a3b1-c860e3be42c6 service nova] Creating event network-vif-deleted:63aec611-e850-4617-b3a8-84ea12cd5966 for instance 37e5c241-e592-4cc6-97f6-a19796815ed6 on hv-cinder-83697 Jun 21 10:50:13.184282 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-42a62535-7ee6-4f56-b00b-efbdf6ddcf73 req-324ca815-020f-4351-a3b1-c860e3be42c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Jun 21 10:50:13.184891 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 487/999] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:14.186135 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:14.186747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 37e5c241-e592-4cc6-97f6-a19796815ed6] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:14.194630 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:14.195073 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:14.195829 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:14.196633 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:14.210839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] HTTP exception thrown: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Request method failure captured: Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 HTTP/1.1 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaB1fT-AsVPhNJvc2vSKzBTMIifumBGAJsvIg45T9_6V9U4wznZycoZwoxv46QwhxO_buRLnGK875aOWfzX-VBGeEdPKc36gdi_8toRkQlWFpe2Gi4qrQwAUnhzL1BJjPALj8qGIrRsRnOrdpqU2J7tGOiRmdCx_eN0OV03P0xObht8 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:50:14.212514 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25adacdcc5b44375b112a93f8623802c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25adacdcc5b44375b112a93f8623802c"}]}] Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f9eaebabd54a45a29f262b67fe1c433b Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. Jun 21 10:50:14.214222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '37e5c241-e592-4cc6-97f6-a19796815ed6'} Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:14.215397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. Jun 21 10:50:14.217211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:14.218687 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Returning 404 to user: Instance 37e5c241-e592-4cc6-97f6-a19796815ed6 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:14.218687 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6f29b11b-efb3-434e-a367-749b3d41679c tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6" status: 404 len: 111 microversion: 2.1 time: 0.034003 Jun 21 10:50:14.218687 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 513/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:14 2022] GET /compute/v2.1/servers/37e5c241-e592-4cc6-97f6-a19796815ed6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:17.389296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:17.390372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:17.394756 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-bb1978d3-d967-41d7-a68c-df630e8d9b6f req-f16d939f-4dd0-4efa-8cb2-8d667c42eabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d58729-e3ad-4fab-9951-142b1802143b", "tag": "b783232c-084d-414d-9238-01324a0ba7cb"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:17.398522 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:17.399054 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:17.399867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:17.400311 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:17.409428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb1978d3-d967-41d7-a68c-df630e8d9b6f req-f16d939f-4dd0-4efa-8cb2-8d667c42eabb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:17.410294 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-bb1978d3-d967-41d7-a68c-df630e8d9b6f req-f16d939f-4dd0-4efa-8cb2-8d667c42eabb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:17.425196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-bb1978d3-d967-41d7-a68c-df630e8d9b6f req-f16d939f-4dd0-4efa-8cb2-8d667c42eabb service nova] Creating event network-changed:b783232c-084d-414d-9238-01324a0ba7cb for instance 08d58729-e3ad-4fab-9951-142b1802143b on hv-cinder-83697 Jun 21 10:50:17.431978 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-bb1978d3-d967-41d7-a68c-df630e8d9b6f req-f16d939f-4dd0-4efa-8cb2-8d667c42eabb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044140 Jun 21 10:50:17.432670 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 514/1001] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:17.435689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:50:17.525597 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-07fbfa37-dfce-4fb7-9e40-4375af777d45 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 204 len: 0 microversion: 2.1 time: 0.140169 Jun 21 10:50:17.526680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 488/1002] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:50:17 2022] DELETE /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:50:17.536050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:17.536769 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:17.543693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:17.544144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:17.545080 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:17.545731 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:17.686477 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:17.694473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-86cd430a-7f6f-4aa1-a3d5-0691c4ceb033 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1576 microversion: 2.1 time: 0.163058 Jun 21 10:50:17.695082 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 515/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:17 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:18.713221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:18.713814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:18.720635 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:18.721073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:18.721930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:18.722397 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:18.930510 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:18.938503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7624ccdf-49f3-4f4a-91c2-f20703fcf860 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1576 microversion: 2.1 time: 0.230243 Jun 21 10:50:18.939084 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 489/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:18 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:19.930643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-f18a21a4-8ac3-4070-a9c4-69ebf4556d03 req-25650263-9eca-45d6-b5cd-be15afe87fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d58729-e3ad-4fab-9951-142b1802143b", "name": "network-vif-deleted", "tag": "b783232c-084d-414d-9238-01324a0ba7cb"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:19.939497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f18a21a4-8ac3-4070-a9c4-69ebf4556d03 req-25650263-9eca-45d6-b5cd-be15afe87fe4 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:19.939946 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-f18a21a4-8ac3-4070-a9c4-69ebf4556d03 req-25650263-9eca-45d6-b5cd-be15afe87fe4 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:19.952085 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-f18a21a4-8ac3-4070-a9c4-69ebf4556d03 req-25650263-9eca-45d6-b5cd-be15afe87fe4 service nova] Creating event network-vif-deleted:b783232c-084d-414d-9238-01324a0ba7cb for instance 08d58729-e3ad-4fab-9951-142b1802143b on hv-cinder-83697 Jun 21 10:50:19.957120 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-f18a21a4-8ac3-4070-a9c4-69ebf4556d03 req-25650263-9eca-45d6-b5cd-be15afe87fe4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031022 Jun 21 10:50:19.957836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:19.958568 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 516/1005] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:19.959533 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:19.967905 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:19.968309 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:19.969424 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:19.969855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:20.036806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9eaebabd54a45a29f262b67fe1c433b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25adacdcc5b44375b112a93f8623802c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:20.044755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0665088b-2222-48f0-9a4f-62d0ad6517a4 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 200 len: 1225 microversion: 2.1 time: 0.092319 Jun 21 10:50:20.045332 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 490/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:19 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:21.063894 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:21.064615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 08d58729-e3ad-4fab-9951-142b1802143b] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:21.071990 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.072438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.073202 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.073644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.087548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] HTTP exception thrown: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Request method failure captured: Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b HTTP/1.1 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaB1fT-AsVPhNJvc2vSKzBTMIifumBGAJsvIg45T9_6V9U4wznZycoZwoxv46QwhxO_buRLnGK875aOWfzX-VBGeEdPKc36gdi_8toRkQlWFpe2Gi4qrQwAUnhzL1BJjPALj8qGIrRsRnOrdpqU2J7tGOiRmdCx_eN0OV03P0xObht8 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:50:21.089217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25adacdcc5b44375b112a93f8623802c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25adacdcc5b44375b112a93f8623802c"}]}] Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f9eaebabd54a45a29f262b67fe1c433b Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. Jun 21 10:50:21.090794 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '08d58729-e3ad-4fab-9951-142b1802143b'} Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:21.091601 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. Jun 21 10:50:21.093018 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.094674 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Returning 404 to user: Instance 08d58729-e3ad-4fab-9951-142b1802143b could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:21.094674 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b19f72da-2cc3-49ec-87d6-968e49f0c755 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b" status: 404 len: 111 microversion: 2.1 time: 0.031786 Jun 21 10:50:21.094674 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 517/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:21 2022] GET /compute/v2.1/servers/08d58729-e3ad-4fab-9951-142b1802143b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:21.581823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:21.582403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:21.590083 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.590558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.591330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.591749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.606364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] HTTP exception thrown: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Request method failure captured: Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d HTTP/1.1 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaB1fT-AsVPhNJvc2vSKzBTMIifumBGAJsvIg45T9_6V9U4wznZycoZwoxv46QwhxO_buRLnGK875aOWfzX-VBGeEdPKc36gdi_8toRkQlWFpe2Gi4qrQwAUnhzL1BJjPALj8qGIrRsRnOrdpqU2J7tGOiRmdCx_eN0OV03P0xObht8 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:50:21.608055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25adacdcc5b44375b112a93f8623802c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25adacdcc5b44375b112a93f8623802c"}]}] Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: f9eaebabd54a45a29f262b67fe1c433b Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.609616 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '18b3df2f-73ff-43d7-b18e-76d349dd118d'} Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:21.610617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.612129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.613693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Returning 404 to user: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:21.613693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-26a3d763-5e02-46b9-9ec6-5f8dd5f04ec8 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "DELETE /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 404 len: 111 microversion: 2.1 time: 0.032234 Jun 21 10:50:21.613693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 491/1008] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:50:21 2022] DELETE /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:21.623658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:21.624280 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] [instance: 18b3df2f-73ff-43d7-b18e-76d349dd118d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:21.631394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.632087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.632881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:21.633325 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:21.647103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] HTTP exception thrown: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Request method failure captured: Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d HTTP/1.1 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaB1fT-AsVPhNJvc2vSKzBTMIifumBGAJsvIg45T9_6V9U4wznZycoZwoxv46QwhxO_buRLnGK875aOWfzX-VBGeEdPKc36gdi_8toRkQlWFpe2Gi4qrQwAUnhzL1BJjPALj8qGIrRsRnOrdpqU2J7tGOiRmdCx_eN0OV03P0xObht8 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:50:21.648571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25adacdcc5b44375b112a93f8623802c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25adacdcc5b44375b112a93f8623802c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25adacdcc5b44375b112a93f8623802c"}]}] Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 25adacdcc5b44375b112a93f8623802c Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestVolumeBootPattern-1107878376 Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: f9eaebabd54a45a29f262b67fe1c433b Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestVolumeBootPattern-1107878376-project Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.650212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '18b3df2f-73ff-43d7-b18e-76d349dd118d'} Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:21.651289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. Jun 21 10:50:21.652811 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:50:21.654553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Returning 404 to user: Instance 18b3df2f-73ff-43d7-b18e-76d349dd118d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:21.654553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-03121d78-7393-4fbe-9c10-d01a0ea4cc08 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d" status: 404 len: 111 microversion: 2.1 time: 0.030657 Jun 21 10:50:21.654553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 518/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:21 2022] GET /compute/v2.1/servers/18b3df2f-73ff-43d7-b18e-76d349dd118d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:22.969184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cf2dea92-c05d-4f76-bdf4-2ed27ba0bfd5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] Calling method '.version_select at 0x7f8a366aa9d0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:22.993476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cf2dea92-c05d-4f76-bdf4-2ed27ba0bfd5 tempest-TestVolumeBootPattern-1107878376 tempest-TestVolumeBootPattern-1107878376-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-396547085" status: 202 len: 0 microversion: 2.1 time: 0.028381 Jun 21 10:50:22.994797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 492/1010] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jun 21 10:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-396547085 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:50:30.087715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:30.088361 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:30.095560 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.096029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.096877 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.097379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.122044 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-acd3ec8f-be5a-4c69-afc9-e1383f85f55c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/ips" status: 200 len: 150 microversion: 2.1 time: 0.038292 Jun 21 10:50:30.122654 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 519/1011] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:50:30 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:30.134401 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee0734a6-e5b6-45e2-87cb-5859280189ec"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:30.135249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:30.142296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.142749 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.143517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.143955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.230071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: POST /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/os-volume_attachments HTTP/1.1 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 74 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:50:30.231708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {"volumeAttachment": {"volumeId": "ee0734a6-e5b6-45e2-87cb-5859280189ec"}} Jun 21 10:50:30.233488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'server_id': 'beb7b0dd-9905-4ca1-8a75-cad097411c7f', 'body': {'volumeAttachment': {'volumeId': 'ee0734a6-e5b6-45e2-87cb-5859280189ec'}}} Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:30.234798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:30.236323 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 400 to user: Invalid volume: volume ee0734a6-e5b6-45e2-87cb-5859280189ec is already attached to instances: 0b6413e8-d55e-46f6-a18a-e3c5a528735e {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3bc69edb-d989-471b-b047-29b0741968be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103918 Jun 21 10:50:30.237889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 493/1012] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:50:30 2022] POST /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 10:50:30.242414 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:30.243339 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:30.249350 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.249820 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.250624 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.251047 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.277656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:50:30.360641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-0404e37c-f7e6-47e4-9a5a-444034aaab92 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 204 len: 0 microversion: 2.1 time: 0.122056 Jun 21 10:50:30.361231 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 520/1013] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:50:30 2022] DELETE /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:50:30.370591 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:30.371154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:30.378099 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.378503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.379333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:30.380576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:30.525461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:30.533450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ece009a6-026e-4a9e-ab81-aae3b01749e4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1681 microversion: 2.1 time: 0.167713 Jun 21 10:50:30.533945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 494/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:30 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:50:31.552815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:31.553526 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:31.560623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:31.561097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:31.561858 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:31.562341 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:31.984551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:31.992139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-746b9359-14eb-4c90-bcec-dd638d08ee17 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1681 microversion: 2.1 time: 0.443655 Jun 21 10:50:31.992708 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 521/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:31 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1681 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:33.010202 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:33.010827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:33.018110 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:33.018618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:33.019353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:33.019787 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:33.110605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:33.118209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a51d6627-dc1d-4b3a-a0a0-bae8b686a151 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 200 len: 1613 microversion: 2.1 time: 0.112282 Jun 21 10:50:33.118927 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 495/1016] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:33 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:33.177249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-6e08bc38-6f82-4ee8-bc78-1838fbb02d9b req-c1b22bea-cc4d-4ece-b7f7-df313069bb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb7b0dd-9905-4ca1-8a75-cad097411c7f", "name": "network-vif-deleted", "tag": "0f0e716f-b88c-40a5-98a5-3c840e543b09"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:33.194865 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6e08bc38-6f82-4ee8-bc78-1838fbb02d9b req-c1b22bea-cc4d-4ece-b7f7-df313069bb5f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:33.195772 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6e08bc38-6f82-4ee8-bc78-1838fbb02d9b req-c1b22bea-cc4d-4ece-b7f7-df313069bb5f service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:33.211546 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-6e08bc38-6f82-4ee8-bc78-1838fbb02d9b req-c1b22bea-cc4d-4ece-b7f7-df313069bb5f service nova] Creating event network-vif-deleted:0f0e716f-b88c-40a5-98a5-3c840e543b09 for instance beb7b0dd-9905-4ca1-8a75-cad097411c7f on hv-cinder-83697 Jun 21 10:50:33.217931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-6e08bc38-6f82-4ee8-bc78-1838fbb02d9b req-c1b22bea-cc4d-4ece-b7f7-df313069bb5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044368 Jun 21 10:50:33.218571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 522/1017] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:34.136226 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:34.136888 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:34.144183 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:34.144644 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:34.145459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:34.145895 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:34.161503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f HTTP/1.1 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:50:34.163268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:50:34.164953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'beb7b0dd-9905-4ca1-8a75-cad097411c7f'} Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:34.166000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:50:34.167517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:34.168839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:34.168839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f301ce44-4f0a-454e-a93a-73dd9468e8dc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 404 len: 111 microversion: 2.1 time: 0.032620 Jun 21 10:50:34.168839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 496/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:34 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:34.175217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-acb3b866-56c2-4170-b3b2-84ed11b51b7d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '.version_select at 0x7f8a35cd01f0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:34.196749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-acb3b866-56c2-4170-b3b2-84ed11b51b7d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671415883" status: 202 len: 0 microversion: 2.1 time: 0.025289 Jun 21 10:50:34.201303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 523/1019] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 21 10:50:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671415883 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:50:34.894501 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:34.895004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:34.901659 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:34.902111 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:34.902886 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:34.903310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:35.131970 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lazy-loading 'services' on Instance uuid 0b6413e8-d55e-46f6-a18a-e3c5a528735e {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:50:35.210402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-52f0e382-e4d6-43b9-bd4f-a60d76c444ef tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments/ee0734a6-e5b6-45e2-87cb-5859280189ec" status: 202 len: 0 microversion: 2.1 time: 0.319716 Jun 21 10:50:35.211353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 497/1020] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:50:34 2022] DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments/ee0734a6-e5b6-45e2-87cb-5859280189ec => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:50:35.221300 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:35.223121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:35.232583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:35.233089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:35.233914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:35.234404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:35.267531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc6c49a4-a03f-4426-a496-7186102e9c38 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050671 Jun 21 10:50:35.271389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 524/1021] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:50:35 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:36.280917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:36.282016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:36.289357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.289972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.291126 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.291754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.329606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-43553308-2f17-42c6-9999-be329c9e5caa tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053478 Jun 21 10:50:36.330077 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 498/1022] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:50:36 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:50:36.396846 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:36.397421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:36.404896 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.405334 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.406129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.406586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.433314 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:50:36.526803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-afdc7161-4764-4341-b4f4-f5cb840ba1c9 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 204 len: 0 microversion: 2.1 time: 0.133517 Jun 21 10:50:36.527415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 525/1023] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:50:36 2022] DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:50:36.535750 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:36.536370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:36.542496 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.542950 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.543755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:36.544190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:36.688646 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:36.696905 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0894b241-5b19-41cb-8453-fa92817aebf4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1681 microversion: 2.1 time: 0.164955 Jun 21 10:50:36.697557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 499/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:36 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:37.715709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:37.716365 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:37.723478 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:37.723937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:37.724708 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:37.725167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:37.860995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:37.872228 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-384dd645-73ad-463a-8b48-fe483e931ad6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1681 microversion: 2.1 time: 0.161083 Jun 21 10:50:37.872835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 526/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:37 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:38.890876 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:38.891469 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:38.898253 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:38.898698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:38.899460 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:38.899889 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:38.919800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:39.112997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:39.120827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8342be4c-3398-4143-910d-58bb2cb5130a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 200 len: 1681 microversion: 2.1 time: 0.234020 Jun 21 10:50:39.121633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 500/1026] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:38 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:39.456948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-55fd7fde-759c-4f3d-ab46-0c0a8b4195ec req-e78fd399-0e73-4acf-9c9b-05d76d2b1c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6413e8-d55e-46f6-a18a-e3c5a528735e", "name": "network-vif-deleted", "tag": "8cd9881e-2aa1-449a-9564-6007e91f5b51"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:39.468472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-55fd7fde-759c-4f3d-ab46-0c0a8b4195ec req-e78fd399-0e73-4acf-9c9b-05d76d2b1c9d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:39.469027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-55fd7fde-759c-4f3d-ab46-0c0a8b4195ec req-e78fd399-0e73-4acf-9c9b-05d76d2b1c9d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:39.482645 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-55fd7fde-759c-4f3d-ab46-0c0a8b4195ec req-e78fd399-0e73-4acf-9c9b-05d76d2b1c9d service nova] Creating event network-vif-deleted:8cd9881e-2aa1-449a-9564-6007e91f5b51 for instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e on hv-cinder-83697 Jun 21 10:50:39.489097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-55fd7fde-759c-4f3d-ab46-0c0a8b4195ec req-e78fd399-0e73-4acf-9c9b-05d76d2b1c9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036740 Jun 21 10:50:39.491592 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 527/1027] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:40.139082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:40.139720 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:40.147178 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:40.147626 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:40.148409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:40.148843 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:40.163936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e HTTP/1.1 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:50:40.165611 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:50:40.167076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '0b6413e8-d55e-46f6-a18a-e3c5a528735e'} Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:50:40.168121 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:50:40.169673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:50:40.171063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:50:40.171063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-05842df9-1411-4f13-84e0-a3e36723dec3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 404 len: 111 microversion: 2.1 time: 0.032241 Jun 21 10:50:40.171063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 501/1028] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:40 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:50:40.177184 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-146a773f-73dd-45ed-b384-7e511e35371d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '.version_select at 0x7f8a3a688c10>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:40.198664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-146a773f-73dd-45ed-b384-7e511e35371d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496532046" status: 202 len: 0 microversion: 2.1 time: 0.025579 Jun 21 10:50:40.199254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 528/1029] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 21 10:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496532046 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:50:40.896409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7cf928ef-3bbf-4cc9-b37e-17b4cc22b31d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: .version_select at 0x7f8a364e7160>, body: {"keypair": {"name": "tempest-keypair-1218987294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiHcn9cBrguYYLANNW2o/2GESSVgGTE8oobBAZyYDhqDxyYtfeY/wwo7BkSLrS5gWctmZ3g5OH3PEy95knrZKjPUJix1rG0OZMCxUVEdv1jpqMZCqDargB+1Oc2WeAVOA=="}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:40.900485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:40.914435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-7cf928ef-3bbf-4cc9-b37e-17b4cc22b31d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:50:40.919420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-7cf928ef-3bbf-4cc9-b37e-17b4cc22b31d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:50:40.947639 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7cf928ef-3bbf-4cc9-b37e-17b4cc22b31d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055097 Jun 21 10:50:40.949085 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 502/1030] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:50:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:42.368027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1688428528", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e610a6-095a-475b-879f-4c63a030f200"}], "security_groups": [{"name": "tempest-securitygroup--1469933402"}], "key_name": "tempest-keypair-1218987294", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:42.375684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:42.484549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] validate_networks() for [('d4e610a6-095a-475b-879f-4c63a030f200', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:50:42.945885 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:50:42.946905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:50:42.947583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:50:42.948176 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:50:42.948798 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:50:42.965119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:42.965563 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:42.966398 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:42.966835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:42.972479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:42.986706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:50:42.990918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:50:43.002713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:50:43.005101 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:50:43.050842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:50:44.059201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [cd673357-9d13-4896-8ad1-2e9dcf790eed] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52716. Jun 21 10:50:44.064346 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-744cb30f-5646-447e-b92d-a91744aff30c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.700742 Jun 21 10:50:44.064986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 529/1031] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:50:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:50:44.077339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4994ba6d-e6b1-4b30-9db7-13a199851044 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:44.078294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4994ba6d-e6b1-4b30-9db7-13a199851044 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:44.185238 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4994ba6d-e6b1-4b30-9db7-13a199851044 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:44.193497 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4994ba6d-e6b1-4b30-9db7-13a199851044 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1242 microversion: 2.1 time: 0.121415 Jun 21 10:50:44.195007 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 503/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:44 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:45.212602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:45.213254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:45.220465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:45.220948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:45.221730 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:45.222190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:45.288926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:45.297707 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc7c029b-7b97-4333-a65b-e8d3fd4fc3ee tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1312 microversion: 2.1 time: 0.089547 Jun 21 10:50:45.298308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 530/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:45 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:46.315027 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:46.315587 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:46.323037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:46.323914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:46.325003 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:46.325650 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:46.566870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:46.575268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7ee07673-0e8d-46c2-824f-c8da1439b72d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.264451 Jun 21 10:50:46.575832 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 504/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:46 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:47.026024 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-6f2a3cb3-3de5-4256-bc17-3cb424f8fb3a req-ba1eff65-fcaf-44d4-a344-72cb23caa340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a47d1d4-e588-456d-87a2-ba448d805f92", "tag": "6ee82b40-2132-41a9-b271-31b19ecf852f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:47.038529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6f2a3cb3-3de5-4256-bc17-3cb424f8fb3a req-ba1eff65-fcaf-44d4-a344-72cb23caa340 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:47.039485 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-6f2a3cb3-3de5-4256-bc17-3cb424f8fb3a req-ba1eff65-fcaf-44d4-a344-72cb23caa340 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:47.052919 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-6f2a3cb3-3de5-4256-bc17-3cb424f8fb3a req-ba1eff65-fcaf-44d4-a344-72cb23caa340 service nova] Creating event network-changed:6ee82b40-2132-41a9-b271-31b19ecf852f for instance 1a47d1d4-e588-456d-87a2-ba448d805f92 on hv-cinder-83697 Jun 21 10:50:47.058403 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-6f2a3cb3-3de5-4256-bc17-3cb424f8fb3a req-ba1eff65-fcaf-44d4-a344-72cb23caa340 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041964 Jun 21 10:50:47.069751 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 531/1035] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:47.594076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:47.594725 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:47.601596 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:47.602039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:47.602804 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:47.603227 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:47.743272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:47.754860 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-51df1840-b09c-489b-b746-9357bebbe54a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.164863 Jun 21 10:50:47.755761 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 505/1036] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:47 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:48.774151 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:48.774789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:48.781850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:48.782102 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:48.782547 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:48.782660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:48.783053 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:48.783481 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:48.788892 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:48.789343 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:48.790090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:48.790539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:48.818142 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-50067273-e79c-4bd4-a07a-c8f8948afdd9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/ips" status: 200 len: 151 microversion: 2.20 time: 0.162624 Jun 21 10:50:48.818977 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 532/1037] 10.222.0.43 () {60 vars in 1288 bytes} [Tue Jun 21 10:50:48 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/ips => generated 151 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:50:48.938969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:48.947032 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7d79cd46-5e1f-4488-b612-a6f0486880c3 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.176739 Jun 21 10:50:48.947577 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 506/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:48 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 10:50:49.964118 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:49.964902 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:49.971871 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:49.972327 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:49.973182 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:49.973744 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:50.119445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:50.127883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bb6ddc08-c154-4e86-82ab-4aa804798c3a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.167642 Jun 21 10:50:50.128425 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 533/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:49 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:51.145394 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:51.145985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:51.153260 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.153844 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.154637 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.155062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.310083 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:51.318252 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-208966e6-7228-4e75-986b-ca300d7388a6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.176852 Jun 21 10:50:51.318833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 507/1040] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:51 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:51.320317 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:51.321332 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:51.328746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.329188 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.329945 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.330411 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.354126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lazy-loading 'flavor' on Instance uuid ea93c513-a1b4-4033-a9eb-31e22a4ff766 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:50:51.544499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-823fa186-a4b2-42ad-a6d8-5a4b4a7c9d03 req-555d7eaf-f8f7-4a40-ab2c-227ce267647b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a47d1d4-e588-456d-87a2-ba448d805f92", "name": "network-vif-plugged", "status": "completed", "tag": "6ee82b40-2132-41a9-b271-31b19ecf852f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:51.557485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-823fa186-a4b2-42ad-a6d8-5a4b4a7c9d03 req-555d7eaf-f8f7-4a40-ab2c-227ce267647b service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.558138 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-823fa186-a4b2-42ad-a6d8-5a4b4a7c9d03 req-555d7eaf-f8f7-4a40-ab2c-227ce267647b service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.572181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-823fa186-a4b2-42ad-a6d8-5a4b4a7c9d03 req-555d7eaf-f8f7-4a40-ab2c-227ce267647b service nova] Creating event network-vif-plugged:6ee82b40-2132-41a9-b271-31b19ecf852f for instance 1a47d1d4-e588-456d-87a2-ba448d805f92 on hv-cinder-83697 Jun 21 10:50:51.578470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-823fa186-a4b2-42ad-a6d8-5a4b4a7c9d03 req-555d7eaf-f8f7-4a40-ab2c-227ce267647b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038868 Jun 21 10:50:51.579457 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 508/1041] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:51.628251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6e2092d2-7214-48c7-8dfa-7c76ddfcedc6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/action" status: 202 len: 0 microversion: 2.20 time: 0.311593 Jun 21 10:50:51.630106 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 534/1042] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 21 10:50:51 2022] POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:50:51.638702 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:51.640067 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:51.646801 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.647353 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.648191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:51.648636 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:51.787098 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:51.797164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:51.799426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:51.801187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-43967c73-397d-44da-922b-1c36dcc87c57 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.167472 Jun 21 10:50:51.802000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 509/1043] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:51 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:50:52.337092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:52.337738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:52.345195 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:52.345641 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:52.346468 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:52.346907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:52.493166 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:52.501565 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a889e738-81dd-4c9e-9e0a-3a77abe18e74 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.169248 Jun 21 10:50:52.502160 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 535/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:52 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:52.822837 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:52.823428 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:52.830711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:52.831156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:52.831925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:52.832392 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:52.969951 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:52.978555 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:52.980024 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:52.981806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1e0aef8d-5cb5-4e52-a472-ec1c950a89a6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.162991 Jun 21 10:50:52.982400 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 510/1045] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:52 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:53.519016 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:53.519682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:53.521611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:53.522307 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:53.528850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:53.529229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:53.530027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:53.530487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:53.684315 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:53.697629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f5365432-b352-421c-b3be-6056e32384e7 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1368 microversion: 2.1 time: 0.182297 Jun 21 10:50:53.698391 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 536/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:53 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:54.004648 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:54.005499 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:54.014901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.015343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.016756 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.017188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.158296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:54.170839 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:54.172349 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:54.173925 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-40768c3b-59f0-4057-8577-1f2aadbfd14e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.175396 Jun 21 10:50:54.174610 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 511/1047] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:53 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:54.717869 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:54.718575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:54.726435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.727000 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.727928 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.728459 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.871621 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:54.879706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c6c2203e-00bd-49bf-892c-65400097ba18 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1558 microversion: 2.1 time: 0.166916 Jun 21 10:50:54.880302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 537/1048] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:50:54 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:50:54.899689 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:54.900472 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:54.903588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:54.909735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.910206 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.910971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:54.911402 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:54.995055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ca17e8e5-d781-443a-99ab-7f15f02ca086 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101338 Jun 21 10:50:54.995959 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 512/1049] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:50:54 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:55.197233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:55.197844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:55.204703 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:55.205144 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:55.205908 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:55.206372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:55.345531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:55.353937 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:55.355452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:55.357422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8699f696-47dc-4b19-b719-6f28bec07c1f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.163863 Jun 21 10:50:55.357996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 538/1050] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:55 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:55.969108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-eab934de-4420-4720-a2b0-e7df6c3d6be0 req-d4579cda-10ff-4761-ba25-bc836b8990d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a47d1d4-e588-456d-87a2-ba448d805f92", "tag": "6ee82b40-2132-41a9-b271-31b19ecf852f"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:50:55.978716 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-eab934de-4420-4720-a2b0-e7df6c3d6be0 req-d4579cda-10ff-4761-ba25-bc836b8990d1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:55.979170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-eab934de-4420-4720-a2b0-e7df6c3d6be0 req-d4579cda-10ff-4761-ba25-bc836b8990d1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:55.991668 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-eab934de-4420-4720-a2b0-e7df6c3d6be0 req-d4579cda-10ff-4761-ba25-bc836b8990d1 service nova] Creating event network-changed:6ee82b40-2132-41a9-b271-31b19ecf852f for instance 1a47d1d4-e588-456d-87a2-ba448d805f92 on hv-cinder-83697 Jun 21 10:50:55.997008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-eab934de-4420-4720-a2b0-e7df6c3d6be0 req-d4579cda-10ff-4761-ba25-bc836b8990d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033023 Jun 21 10:50:55.997732 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 513/1051] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:50:56.376374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:56.377825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:56.385614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:56.386456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:56.387693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:56.388533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:56.530397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:56.540750 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:56.542301 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:56.543473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ae58821a-5ea9-4846-bea3-2d26d7ec6fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.171650 Jun 21 10:50:56.545310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 539/1052] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:56 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:57.563256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:57.563923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:57.570629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:57.571441 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:57.572191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:57.572617 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:57.710992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:57.719131 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:57.720630 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:57.721775 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1921ee1a-79d9-4857-bae8-efff3b78da29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.163266 Jun 21 10:50:57.722417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 514/1053] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:57 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:58.744249 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:58.744896 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:58.752587 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:58.753031 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:58.753786 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:58.754254 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:58.902131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:58.914371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:58.916814 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:50:58.918793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a64738d3-cc9b-4ff6-9920-140909b48e71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.178257 Jun 21 10:50:58.919396 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 540/1054] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:58 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:50:59.937796 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:50:59.938482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:50:59.945800 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:59.946619 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:50:59.947371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:50:59.947790 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:00.085167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:00.095326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:00.096822 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:00.098370 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a6e5f873-e3f5-41b1-8e28-531a0ca41439 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.165176 Jun 21 10:51:00.099026 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 515/1055] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:50:59 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:01.119889 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:01.120559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:01.128323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:01.128807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:01.129567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:01.130002 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:01.271156 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:01.283457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:01.285668 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:01.287347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d87979c9-a71b-4b3f-8cbe-288452056e65 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.173685 Jun 21 10:51:01.288087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 541/1056] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:01 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:02.308764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:02.309365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:02.316955 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:02.317395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:02.318191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:02.318613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:02.484969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:02.497878 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:02.500275 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:02.501829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-912a1270-ed56-4a46-b794-8780492b2efa tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.197052 Jun 21 10:51:02.502454 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 516/1057] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:02 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:03.520649 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:03.521337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:03.528290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:03.528673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:03.529439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:03.529873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:03.666945 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:03.675260 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:03.676765 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:03.677936 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d466e564-4d7d-4482-bdf3-2d0f1fed801f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1745 microversion: 2.20 time: 0.161551 Jun 21 10:51:03.678610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 542/1058] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:03 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:04.699524 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:04.700321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:04.709623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:04.710271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:04.711305 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:04.711913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:04.864827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:04.872975 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:04.874482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:04.875645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e54e7278-3d0b-43a4-a9d2-d3f09ee60fc5 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1745 microversion: 2.20 time: 0.182058 Jun 21 10:51:04.876178 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 517/1059] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:04 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:05.612656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-c2d6c401-ce05-480c-9782-29fd8217bfc5 req-9dcb2a14-da09-4575-aec8-ef7826199b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "name": "network-vif-plugged", "status": "completed", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:51:05.621939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c2d6c401-ce05-480c-9782-29fd8217bfc5 req-9dcb2a14-da09-4575-aec8-ef7826199b81 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:05.622499 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-c2d6c401-ce05-480c-9782-29fd8217bfc5 req-9dcb2a14-da09-4575-aec8-ef7826199b81 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:05.634696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-c2d6c401-ce05-480c-9782-29fd8217bfc5 req-9dcb2a14-da09-4575-aec8-ef7826199b81 service nova] Creating event network-vif-plugged:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:51:05.639848 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-c2d6c401-ce05-480c-9782-29fd8217bfc5 req-9dcb2a14-da09-4575-aec8-ef7826199b81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030935 Jun 21 10:51:05.640444 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 543/1060] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:51:05.896213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:05.896773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:05.903819 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:05.904272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:05.905072 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:05.905483 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:06.051777 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:06.065041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:06.066584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:06.067774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6f25691d-e4f9-468f-aa45-768e5a3869c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1745 microversion: 2.20 time: 0.176703 Jun 21 10:51:06.068331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 518/1061] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:05 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:07.088164 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:07.088818 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:07.095505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:07.095948 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:07.097212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:07.097677 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:07.232153 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:07.241531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:07.243036 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:07.244201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e6f1147b-39f7-47c2-8fdf-7f16677f5606 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1745 microversion: 2.20 time: 0.160853 Jun 21 10:51:07.244718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 544/1062] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:07 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:08.262090 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:08.262711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:08.269601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:08.270071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:08.270851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:08.271281 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:08.411247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:08.419551 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:08.421094 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:08.422317 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-83a8f9ec-08c4-4479-8305-336798f4930f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.164180 Jun 21 10:51:08.422856 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 519/1063] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:08 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:51:09.444627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:09.445232 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:09.454386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:09.455015 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:09.455972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:09.456506 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:09.633819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:09.642303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:09.644119 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:09.645293 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ef815688-b312-489e-8382-a2e4e33c70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.208209 Jun 21 10:51:09.645844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 545/1064] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:09 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 10:51:10.665018 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:10.666384 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:10.678256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:10.679046 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:10.679823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:10.680213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:10.713614 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=91 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:10.844467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:10.853618 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:10.855553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:10.856866 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f0c5fbe5-b1f4-44f6-98d5-05ed40064474 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.196062 Jun 21 10:51:10.857495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 520/1065] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:10 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:11.878017 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:11.879432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:11.888792 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:11.889236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:11.890010 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:11.890464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:11.894592 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:12.039053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:12.047907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:12.049530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:12.051758 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7ed03bd9-6f3e-4776-bf42-6b5b279bee71 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.178046 Jun 21 10:51:12.052321 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 546/1066] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:11 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:13.071629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:13.072855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:13.075628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:13.083666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:13.084909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:13.085788 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:13.086334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:13.238870 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:13.247615 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:13.249118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:13.250335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ad26f37b-d925-4aa6-b1e6-738253930a9c tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.184104 Jun 21 10:51:13.262163 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 521/1067] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:13 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:14.269752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:14.270771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:14.273532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:14.279311 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:14.279823 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:14.280652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:14.280963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:14.445553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:14.454502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:14.456972 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:14.458173 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ed785fea-fe74-4553-86d8-c6aa44a0efc9 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.192674 Jun 21 10:51:14.458980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 547/1068] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:14 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:15.484187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:15.484874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:15.492262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:15.492765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:15.493589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:15.494167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:15.658621 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:15.668454 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:15.670219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:15.671552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-195bfc98-eb7b-4eb0-856b-c7376c049412 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.195621 Jun 21 10:51:15.683909 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 522/1069] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:15 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:16.691579 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:16.692335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:16.700046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:16.700519 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:16.701305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:16.701773 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:16.874913 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:16.883473 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:16.884987 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:16.886268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a88c60ac-4586-423a-9135-4453bafc70c4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.198873 Jun 21 10:51:16.886819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 548/1070] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:16 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:17.906368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:17.906981 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:17.914892 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:17.915337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:17.916103 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:17.916540 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:18.062218 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:18.071277 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:18.072816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:18.073991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-40ee6441-7c1a-444f-a5c7-d0ddbafcf6cd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1740 microversion: 2.20 time: 0.172142 Jun 21 10:51:18.074583 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 523/1071] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:17 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:19.097527 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:19.098134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:19.106129 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:19.106982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:19.107964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:19.108407 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:19.263291 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:19.272693 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:19.274211 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:19.275430 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2d718d7c-cb87-4a18-9b99-fff65c6f0ca4 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1722 microversion: 2.20 time: 0.182400 Jun 21 10:51:19.276030 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 549/1072] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:19 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:20.294715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:20.295316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:20.303224 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:20.303673 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:20.304444 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:20.304879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:20.456716 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:20.465576 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:20.467096 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:20.468267 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7d494035-9a80-453f-bac1-ea52c1c23562 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1722 microversion: 2.20 time: 0.177616 Jun 21 10:51:20.468824 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 524/1073] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:20 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:21.487385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:21.487975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:21.494540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:21.494996 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:21.495768 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:21.496206 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:21.632471 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:21.643005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:21.644869 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:21.647385 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-aeef2e78-4176-4b86-8304-db8c8e0934fe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1725 microversion: 2.20 time: 0.163835 Jun 21 10:51:21.647941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 550/1074] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:21 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:21.664823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-5fc03262-d1df-4134-8447-0c1d360084b5 req-7645b171-5de9-407c-911a-4ffdb5ca1c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "name": "network-vif-unplugged", "status": "completed", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:51:21.665944 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb72d609-f418-4d57-9343-5cfc8f3ef85d"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:51:21.667233 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:21.674534 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5fc03262-d1df-4134-8447-0c1d360084b5 req-7645b171-5de9-407c-911a-4ffdb5ca1c59 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:21.674772 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:21.674956 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-5fc03262-d1df-4134-8447-0c1d360084b5 req-7645b171-5de9-407c-911a-4ffdb5ca1c59 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:21.675117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:21.675783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:21.677105 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:21.688062 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.compute.server_external_events [req-5fc03262-d1df-4134-8447-0c1d360084b5 req-7645b171-5de9-407c-911a-4ffdb5ca1c59 service nova] Unable to find a host for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766. Dropping event network-vif-unplugged {{(pid=124180) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 10:51:21.689219 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-5fc03262-d1df-4134-8447-0c1d360084b5 req-7645b171-5de9-407c-911a-4ffdb5ca1c59 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028927 Jun 21 10:51:21.689811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 525/1075] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 10:51:21.994487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1fa92064-629b-439c-a795-75385099905b tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333391 Jun 21 10:51:21.995310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 551/1076] 10.222.0.43 () {62 vars in 1363 bytes} [Tue Jun 21 10:51:21 2022] POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 10:51:22.122232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:22.122721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:22.128838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.129926 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.130721 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.131154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.401508 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3c6c72a1-a6d8-47fd-bfff-f2541c95e808 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments/eb72d609-f418-4d57-9343-5cfc8f3ef85d" status: 202 len: 0 microversion: 2.20 time: 0.283201 Jun 21 10:51:22.402107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 526/1077] 10.222.0.43 () {60 vars in 1456 bytes} [Tue Jun 21 10:51:22 2022] DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments/eb72d609-f418-4d57-9343-5cfc8f3ef85d => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:51:22.459389 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:51:22.460008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:22.468777 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.469241 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.470022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.470490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.555438 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-98889743-3b61-48ff-8c5f-99a550f1c639 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/action" status: 202 len: 0 microversion: 2.20 time: 0.100693 Jun 21 10:51:22.556140 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 552/1078] 10.222.0.43 () {62 vars in 1318 bytes} [Tue Jun 21 10:51:22 2022] POST /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 10:51:22.564333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:22.565582 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:22.572972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.573420 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.574249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:22.574686 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:22.712157 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:22.720046 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:22.721530 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:22.722745 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-eba1d08a-7d67-451e-b407-ebef48274356 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1673 microversion: 2.20 time: 0.162464 Jun 21 10:51:22.723669 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 527/1079] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:22 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:23.741635 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:23.742239 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:23.748609 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:23.749062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:23.749838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:23.750308 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:23.888728 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:23.897453 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:23.899087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:23.900277 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ae6038a4-46bc-4926-ad6e-03ebb3632a88 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1675 microversion: 2.20 time: 0.163196 Jun 21 10:51:23.900851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 553/1080] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:23 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:24.919356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:24.919963 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:24.926854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:24.927445 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:24.928470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:24.928903 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:25.065352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:25.079214 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:25.081025 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:25.091498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-5864674f-400e-40b9-8bbe-6ebe96ea5951 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.176039 Jun 21 10:51:25.092502 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 528/1081] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:24 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:26.114286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:26.114854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:26.121819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:26.122316 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:26.123084 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:26.123517 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:26.264586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:26.277582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:26.279352 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:26.280605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9cc3522d-3352-439f-b328-8ee0ae4270c8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.170496 Jun 21 10:51:26.292347 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 554/1082] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:26 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:27.299902 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:27.300517 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:27.307506 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:27.307952 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:27.308735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:27.309181 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:27.457471 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:27.467473 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:27.468969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:27.470322 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3fcbb6ef-00da-42cd-bb52-552bd0017e29 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.174407 Jun 21 10:51:27.471038 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 529/1083] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:27 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:28.489748 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:28.490809 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:28.497821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:28.498295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:28.499058 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:28.500583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:28.665918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:28.674764 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:28.676673 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:28.678682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ce785c8b-2e15-47a2-beba-435c155fb8a2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.193057 Jun 21 10:51:28.689434 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 555/1084] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:28 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:29.698279 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:29.699097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:29.705916 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:29.706389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:29.707165 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:29.707599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:29.849854 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:29.860574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:29.862190 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:29.863416 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-295e6f66-b786-4894-b441-5577e818bad8 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.170279 Jun 21 10:51:29.863932 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 530/1085] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:29 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:30.882844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:30.883551 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:30.891916 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:30.892371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:30.893152 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:30.893576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:31.031203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:31.041214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:31.043050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:31.044422 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-cd8b59f0-11e7-4fb5-b4d5-fcb4a048cac6 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.166292 Jun 21 10:51:31.055738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 556/1086] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:30 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:32.065013 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:32.065816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:32.073504 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:32.074356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:32.075543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:32.076222 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:32.221671 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:32.230354 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:32.231858 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:32.233037 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fa10ad28-bbc6-4cb5-9abe-c0e13a305bdb tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.173182 Jun 21 10:51:32.233602 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 531/1087] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:32 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:33.252027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:33.252634 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:33.260141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:33.260881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:33.261883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:33.262342 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:33.408476 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:33.417570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:33.419535 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:33.421302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e1f317f6-c7a3-4dda-9781-fc3ffe3edafd tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.173104 Jun 21 10:51:33.423150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 557/1088] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:33 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:34.440268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:34.440928 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:34.448271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:34.449231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:34.450003 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:34.450475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:34.613357 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:34.623867 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:34.625316 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:34.626500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4e65eb54-a6d0-40a6-ba2a-e48803b28fce tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.190308 Jun 21 10:51:34.627049 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 532/1089] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:34 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:35.649783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:35.650435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:35.660037 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:35.660655 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:35.661746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:35.662382 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:35.809063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:35.817229 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:35.818745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:35.819901 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ece9a41a-dfc2-4e14-847a-5a334eaa8517 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.175782 Jun 21 10:51:35.820448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 558/1090] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:35 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:36.839156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:36.840068 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:36.847314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:36.847755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:36.848512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:36.848940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:36.988017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:37.000896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:37.003165 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:37.004680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-30d93e83-ae54-439e-8153-688955331468 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.169656 Jun 21 10:51:37.005537 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 533/1091] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:36 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:38.026429 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:38.027236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:38.034401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:38.034853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:38.035618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:38.036052 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:38.038602 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:38.178292 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:38.188050 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:38.189547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:38.190745 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ebf3fa1a-181c-42c5-baea-26a04a65f80f tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.169857 Jun 21 10:51:38.191304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 559/1092] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:38 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:39.212223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:39.213033 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:39.222764 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:39.223395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:39.224414 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:39.225020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:39.364969 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:39.368450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:39.373567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:39.375085 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:39.376298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-41c2e76f-3c6e-412e-86ff-738848f3c034 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.169552 Jun 21 10:51:39.376851 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 534/1093] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:39 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:40.395197 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:40.395827 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:40.403653 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:40.404100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:40.404862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:40.405291 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:40.545714 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:40.553713 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:40.555255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:40.556417 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bc7db8cf-f19c-4c4e-9b18-0c4d2b05c98d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.165291 Jun 21 10:51:40.556975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 560/1094] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:40 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:41.576898 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:41.577556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:41.587412 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:41.587864 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:41.588651 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:41.589088 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:41.749161 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:41.758259 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:41.759732 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:41.760962 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6bb3d5fb-037f-469c-bd09-41b94dea2007 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.188750 Jun 21 10:51:41.761656 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 535/1095] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:41 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:42.779593 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:42.780161 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:42.787324 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:42.787781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:42.788548 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:42.788979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:42.924721 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:42.938125 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:42.940633 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:42.942540 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4f53db13-763b-45f6-ada0-d4071f9b0900 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.166741 Jun 21 10:51:42.943463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 561/1096] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:42 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:43.847631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-26771386-d890-401e-a43c-4e74ddac60cb req-cdab9116-342e-4662-8902-24c02907556d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "name": "network-vif-plugged", "status": "completed", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:51:43.853304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=30 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:43.861060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-26771386-d890-401e-a43c-4e74ddac60cb req-cdab9116-342e-4662-8902-24c02907556d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:43.861736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-26771386-d890-401e-a43c-4e74ddac60cb req-cdab9116-342e-4662-8902-24c02907556d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:43.876386 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-26771386-d890-401e-a43c-4e74ddac60cb req-cdab9116-342e-4662-8902-24c02907556d service nova] Creating event network-vif-plugged:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:51:43.882080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-26771386-d890-401e-a43c-4e74ddac60cb req-cdab9116-342e-4662-8902-24c02907556d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038183 Jun 21 10:51:43.882670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 536/1097] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:51:43.964997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:43.965776 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:43.973207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:43.973690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:43.974576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:43.975328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:44.116500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:44.126143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:44.127747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:44.129001 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-946ac4c8-ff5e-49a1-9afe-ebcdfd0beb20 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.168078 Jun 21 10:51:44.129643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 562/1098] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:43 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:45.148365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:45.149056 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:45.156772 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:45.157221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:45.157989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:45.158461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:45.364829 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:45.376561 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:45.378141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:45.379449 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7b784995-8f11-44e6-a602-454a671aadfe tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.235406 Jun 21 10:51:45.380335 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 537/1099] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:45 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:46.402016 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:46.402729 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:46.407658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=34 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:46.411445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:46.411898 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:46.412699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:46.413138 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:46.554652 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:46.562971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:46.564394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:46.565573 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-4fd3adbb-5bae-45fd-bd01-d53c28536285 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1731 microversion: 2.20 time: 0.169454 Jun 21 10:51:46.566181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 563/1100] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:46 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:51:47.585302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:51:47.585913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:51:47.592954 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:47.593405 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:47.594202 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:51:47.594633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:51:47.734439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:47.746118 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:47.748418 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:51:47.750235 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-65e476d5-e781-4d13-bc94-cccee003d926 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1718 microversion: 2.20 time: 0.168910 Jun 21 10:51:47.750791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 538/1101] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:51:47 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:52:12.094100 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:12.094849 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=29 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:12.149337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:12.149842 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:12.156217 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:12.156683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:12.157449 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:12.157883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:12.181032 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eeebe44a-3622-47ae-913f-5e2ca34a6fdc tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/ips" status: 200 len: 149 microversion: 2.1 time: 0.091902 Jun 21 10:52:12.181584 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 564/1102] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:52:12 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/ips => generated 149 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:13.519363 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f762670c-ddb6-4538-bf76-62d85f516596"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:13.520605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:13.524034 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=5 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:13.524649 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=20 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:13.531684 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:13.532124 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:13.532899 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:13.533361 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:13.832344 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6c14e86c-3580-42fb-a9ef-0623411d88be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318806 Jun 21 10:52:13.833004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 539/1103] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:52:13 2022] POST /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:21.383882 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f762670c-ddb6-4538-bf76-62d85f516596"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:21.385321 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:21.393114 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.393564 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.394388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.394818 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.490374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: POST /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments HTTP/1.1 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 74 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:52:21.492121 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {"volumeAttachment": {"volumeId": "f762670c-ddb6-4538-bf76-62d85f516596"}} Jun 21 10:52:21.493684 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'server_id': '1a47d1d4-e588-456d-87a2-ba448d805f92', 'body': {'volumeAttachment': {'volumeId': 'f762670c-ddb6-4538-bf76-62d85f516596'}}} Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:21.494920 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:21.496522 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 400 to user: Invalid volume: volume f762670c-ddb6-4538-bf76-62d85f516596 is already attached to instances: 1a47d1d4-e588-456d-87a2-ba448d805f92 {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eccfacdd-897d-4d0b-86c9-89ebac7f203a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116339 Jun 21 10:52:21.498474 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 565/1104] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:52:21 2022] POST /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:52:21.561398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:21.562031 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:21.568566 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.569011 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.569781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.570258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.658770 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.objects.instance [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lazy-loading 'services' on Instance uuid 1a47d1d4-e588-456d-87a2-ba448d805f92 {{(pid=124180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:52:21.739660 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-68ff317c-6ef0-419b-8f47-b1bf17e53fa5 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments/f762670c-ddb6-4538-bf76-62d85f516596" status: 202 len: 0 microversion: 2.1 time: 0.185822 Jun 21 10:52:21.740488 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 540/1105] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:52:21 2022] DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments/f762670c-ddb6-4538-bf76-62d85f516596 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:52:21.750867 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:21.751819 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:21.759599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.760237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.761194 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:21.761729 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:21.797783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b28b15b0-ae12-45ae-a8ec-a3dd5f0ce92a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 Jun 21 10:52:21.798370 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 566/1106] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:52:21 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:22.814129 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:22.815415 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:22.825063 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:22.825640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:22.826709 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:22.827271 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:22.856930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f3e74ee7-bbcc-4274-b5b0-2c132775e71d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049960 Jun 21 10:52:22.857487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 541/1107] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:52:22 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:52:22.917685 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:22.918250 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:22.925747 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:22.926235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:22.927002 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:22.927442 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:22.953741 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:52:23.040529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9baf6009-7350-4ef9-a502-a5c2f14667dd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 204 len: 0 microversion: 2.1 time: 0.126344 Jun 21 10:52:23.041277 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 567/1108] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:52:22 2022] DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:52:23.049451 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:23.050082 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:23.056157 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:23.056601 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:23.057360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:23.057791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:23.203685 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:23.211588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7b10c850-9a90-4dd0-bafb-b76f228057d4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1682 microversion: 2.1 time: 0.166054 Jun 21 10:52:23.212157 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 542/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:23 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:24.230698 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:24.231300 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:24.239012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:24.239456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:24.240216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:24.240644 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:24.391113 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:24.401808 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8fb7eb0e-632d-4cbb-8fe3-3d49ccadf9d6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1682 microversion: 2.1 time: 0.175534 Jun 21 10:52:24.402636 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 568/1110] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:24 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:25.425339 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:25.425923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:25.433015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:25.433464 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:25.434272 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:25.434707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:25.662567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:25.674755 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-bbc0f0c0-2e5c-44d5-9c7c-68dbfe41ef40 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 200 len: 1682 microversion: 2.1 time: 0.253126 Jun 21 10:52:25.675797 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 543/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:25 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:26.153338 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-57de8aaf-e344-4fbc-893d-503024816708 req-5300d496-602d-4b42-b6e9-4e546df0afff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a47d1d4-e588-456d-87a2-ba448d805f92", "name": "network-vif-deleted", "tag": "6ee82b40-2132-41a9-b271-31b19ecf852f"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:26.162600 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-57de8aaf-e344-4fbc-893d-503024816708 req-5300d496-602d-4b42-b6e9-4e546df0afff service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:26.163137 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-57de8aaf-e344-4fbc-893d-503024816708 req-5300d496-602d-4b42-b6e9-4e546df0afff service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:26.177963 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-57de8aaf-e344-4fbc-893d-503024816708 req-5300d496-602d-4b42-b6e9-4e546df0afff service nova] Creating event network-vif-deleted:6ee82b40-2132-41a9-b271-31b19ecf852f for instance 1a47d1d4-e588-456d-87a2-ba448d805f92 on hv-cinder-83697 Jun 21 10:52:26.185058 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-57de8aaf-e344-4fbc-893d-503024816708 req-5300d496-602d-4b42-b6e9-4e546df0afff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110440 Jun 21 10:52:26.189841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 569/1112] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:26.695080 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:26.696078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:26.704073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:26.704519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:26.705295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:26.705735 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:26.719487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 HTTP/1.1 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:52:26.721164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:52:26.722662 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '1a47d1d4-e588-456d-87a2-ba448d805f92'} Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:26.723947 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:52:26.725631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:26.727288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:26.727288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ec09e058-7f6f-4f21-b591-f42999d2ec94 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 404 len: 111 microversion: 2.1 time: 0.031487 Jun 21 10:52:26.727288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 544/1113] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:26 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:52:26.732618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-53c9dd88-8cbc-48d9-b185-e3529a70552d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '.version_select at 0x7f8a35ed5820>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:26.751863 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-53c9dd88-8cbc-48d9-b185-e3529a70552d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218987294" status: 202 len: 0 microversion: 2.1 time: 0.023437 Jun 21 10:52:26.755723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 570/1114] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jun 21 10:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218987294 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:52:27.257075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:52:27.257351 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Tue Jun 21 10:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:52:27.406097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e5a27031-ede1-4563-ad86-b8a81e280e47 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: .version_select at 0x7f8a366ef8b0>, body: {"keypair": {"name": "tempest-keypair-744435879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5DGw+uRFPhY/qco6+IEZaiUfCh4R9eIqNdCAucxgbykM6Ssk5uSymDySz0z5Ml/6vqloXInkvh2XNe0FFa/AroND+gLIeILaG45FA0TssHEcwa3hOzmyT0pvU4gUzKOw=="}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:27.422414 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-e5a27031-ede1-4563-ad86-b8a81e280e47 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:52:27.426485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-e5a27031-ede1-4563-ad86-b8a81e280e47 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'key_pairs'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:52:27.453664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e5a27031-ede1-4563-ad86-b8a81e280e47 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051591 Jun 21 10:52:27.454317 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 545/1115] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:52:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:28.752244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1855436047", "imageRef": "a1e102bb-c142-4d84-9e41-71c98bbc489b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e610a6-095a-475b-879f-4c63a030f200"}], "security_groups": [{"name": "tempest-securitygroup--1265819866"}], "key_name": "tempest-keypair-744435879", "user_data": "}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:28.858268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.network.neutron [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] validate_networks() for [('d4e610a6-095a-475b-879f-4c63a030f200', None, None, None, None, None)] {{(pid=124179) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:52:29.261575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:52:29.262268 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image limits 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:52:29.263020 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Flavor pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:52:29.263409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Image pref 0:0:0 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:52:29.263983 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.virt.hardware [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:52:29.274524 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:29.274524 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:29.275368 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:29.275803 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:29.293929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:52:29.300484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Getting quotas for user b6173a38d9234fb383c0ba017e459372 and project 5c45b12dc0ce4d0a86fcc176c0cf3d67. Resources: {'ram', 'cores', 'instances'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:52:29.313862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Going to run 1 instances... {{(pid=124179) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:52:29.316290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1e102bb-c142-4d84-9e41-71c98bbc489b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:52:29.369207 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-596e0181-53c0-46bb-95c0-7e4ada0dca1f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621870 Jun 21 10:52:29.370238 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 571/1116] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:52:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:52:29.382200 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-311f52bf-8bbe-4df3-9679-7065ee7a229d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:29.383055 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-311f52bf-8bbe-4df3-9679-7065ee7a229d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:29.447039 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-311f52bf-8bbe-4df3-9679-7065ee7a229d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:29.454461 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-311f52bf-8bbe-4df3-9679-7065ee7a229d tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1241 microversion: 2.1 time: 0.076697 Jun 21 10:52:29.455044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 546/1117] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:29 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:30.472073 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:30.472651 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:30.480558 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:30.481127 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:30.481925 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:30.482386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:30.557472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:30.565497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-355be027-907f-4221-8752-3302e5d65a58 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1301 microversion: 2.1 time: 0.097991 Jun 21 10:52:30.566296 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 572/1118] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:30 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:31.582707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:31.583325 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:31.590086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:31.590760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:31.591516 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:31.591972 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:32.083997 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:32.091811 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-81f5d0c5-cb91-41bf-8217-579bdf652940 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.513031 Jun 21 10:52:32.092376 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 547/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:31 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:32.241203 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-b8d95cb8-8d15-413c-91ea-1c4ad52ad878 req-e4bf513a-3fb7-480f-a4a5-018c62a9502d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f9caca-98a3-4301-a148-e3ac30f3ac5d", "tag": "9d2a0156-f682-4870-8585-5b82ce851f4b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:32.250497 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b8d95cb8-8d15-413c-91ea-1c4ad52ad878 req-e4bf513a-3fb7-480f-a4a5-018c62a9502d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:32.251523 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-b8d95cb8-8d15-413c-91ea-1c4ad52ad878 req-e4bf513a-3fb7-480f-a4a5-018c62a9502d service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:32.276046 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-b8d95cb8-8d15-413c-91ea-1c4ad52ad878 req-e4bf513a-3fb7-480f-a4a5-018c62a9502d service nova] Creating event network-changed:9d2a0156-f682-4870-8585-5b82ce851f4b for instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d on hv-cinder-83697 Jun 21 10:52:32.285386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-b8d95cb8-8d15-413c-91ea-1c4ad52ad878 req-e4bf513a-3fb7-480f-a4a5-018c62a9502d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049026 Jun 21 10:52:32.286337 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 573/1120] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:33.110620 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:33.111409 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:33.119587 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:33.120028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:33.120789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:33.121215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:33.267978 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:33.276669 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9c0b6d21-6d73-42fc-8693-1dfe390e7868 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.170801 Jun 21 10:52:33.277403 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 548/1121] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:33 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:34.295012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:34.295715 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:34.303770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:34.304215 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:34.304979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:34.305404 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:34.454134 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:34.462472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-55d8a345-b9c4-4809-9936-8a8a8cf8fc62 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.171667 Jun 21 10:52:34.463037 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 574/1122] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:34 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:35.480729 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:35.481332 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:35.489250 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:35.489713 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:35.490505 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:35.490941 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:35.710484 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:35.719681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8074032f-d697-44ba-931d-b358adc66fcd tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.242878 Jun 21 10:52:35.720268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 549/1123] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:35 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:36.737328 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:36.737955 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:36.744975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:36.745401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:36.746215 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:36.746650 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:36.890475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:36.902511 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f1831162-d072-48ca-89da-301eef087fb0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.169019 Jun 21 10:52:36.903323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 575/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:36 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:37.921146 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:37.921752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:37.929105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:37.929554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:37.930358 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:37.930795 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:38.064263 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:38.072348 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3491fdec-794e-4800-b45b-e5164242e49c tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.155081 Jun 21 10:52:38.073192 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 550/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:37 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:39.091863 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:39.092488 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:39.099605 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:39.100065 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:39.100821 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:39.101255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:39.246005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:39.253929 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-774f711a-bc86-47e9-989b-a96477d77e12 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.166029 Jun 21 10:52:39.254727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 576/1126] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:39 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:40.192148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-7d5f2d66-9e86-4e44-8f70-cb8733061983 req-5753b617-7087-401a-a35b-fbc16a09f2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f9caca-98a3-4301-a148-e3ac30f3ac5d", "name": "network-vif-plugged", "status": "completed", "tag": "9d2a0156-f682-4870-8585-5b82ce851f4b"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:40.199153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:40.204293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7d5f2d66-9e86-4e44-8f70-cb8733061983 req-5753b617-7087-401a-a35b-fbc16a09f2cb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:40.204874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7d5f2d66-9e86-4e44-8f70-cb8733061983 req-5753b617-7087-401a-a35b-fbc16a09f2cb service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:40.217948 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-7d5f2d66-9e86-4e44-8f70-cb8733061983 req-5753b617-7087-401a-a35b-fbc16a09f2cb service nova] Creating event network-vif-plugged:9d2a0156-f682-4870-8585-5b82ce851f4b for instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d on hv-cinder-83697 Jun 21 10:52:40.223319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-7d5f2d66-9e86-4e44-8f70-cb8733061983 req-5753b617-7087-401a-a35b-fbc16a09f2cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Jun 21 10:52:40.223936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 551/1127] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:40.271463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:40.272336 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:40.274193 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:40.274837 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:40.282931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:40.284065 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:40.284999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:40.285423 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:40.429159 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:40.437918 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-94c99285-a911-4f45-a7b3-a78debdda333 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.170987 Jun 21 10:52:40.438543 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 577/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:40 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:41.457216 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:41.457932 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:41.464823 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:41.465270 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:41.466011 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:41.466500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:41.605438 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:41.615603 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-755adc1f-8ead-4051-b926-87a637119066 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1367 microversion: 2.1 time: 0.163215 Jun 21 10:52:41.616179 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 552/1129] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:41 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:42.633507 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:42.634237 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:42.636575 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:42.643090 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:42.643681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:42.644454 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:42.645092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:42.649439 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:42.791700 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:42.800052 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8da6edcc-d5d5-41b1-9584-d2679c3569f1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1557 microversion: 2.1 time: 0.170467 Jun 21 10:52:42.800897 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 578/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:52:42 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:42.817915 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:42.818494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:42.825556 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:42.826017 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:42.826818 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:42.827302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:42.909833 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-aecfa50a-a510-4663-a787-53f4ef66fba6 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095996 Jun 21 10:52:42.910459 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 553/1131] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jun 21 10:52:42 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:44.104304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-7da0d121-3a83-4c01-992f-839c61702697 req-4345c4bf-52b7-4f18-9b61-4a8c17592b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f9caca-98a3-4301-a148-e3ac30f3ac5d", "tag": "9d2a0156-f682-4870-8585-5b82ce851f4b"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:44.114034 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7da0d121-3a83-4c01-992f-839c61702697 req-4345c4bf-52b7-4f18-9b61-4a8c17592b83 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:44.114510 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-7da0d121-3a83-4c01-992f-839c61702697 req-4345c4bf-52b7-4f18-9b61-4a8c17592b83 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:44.129240 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-7da0d121-3a83-4c01-992f-839c61702697 req-4345c4bf-52b7-4f18-9b61-4a8c17592b83 service nova] Creating event network-changed:9d2a0156-f682-4870-8585-5b82ce851f4b for instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d on hv-cinder-83697 Jun 21 10:52:44.134942 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-7da0d121-3a83-4c01-992f-839c61702697 req-4345c4bf-52b7-4f18-9b61-4a8c17592b83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034171 Jun 21 10:52:44.135683 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 579/1132] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:52.644687 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:52.645605 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:52.647624 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:52.653330 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.653773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:52.654574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.655010 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:52.658273 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:52.687298 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8de9adb1-b6ed-4374-8026-9a959cd23a25 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047334 Jun 21 10:52:52.687855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 554/1133] 10.222.0.43 () {60 vars in 1342 bytes} [Tue Jun 21 10:52:52 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:52:52.751435 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:52.751960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:52.759175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.759624 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:52.760443 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.760795 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:52.786479 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Going to try to terminate instance {{(pid=124179) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:52:52.869967 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-951b0a1f-59e6-4e87-9975-276b4615c839 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 204 len: 0 microversion: 2.20 time: 0.122929 Jun 21 10:52:52.870502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 580/1134] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 21 10:52:52 2022] DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:52:52.879255 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:52.879897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:52.886885 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.887332 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:52.888092 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:52.888532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:53.031703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:53.040769 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:53.042294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:53.043463 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-84a909f1-81a0-4f09-b174-077ad31911db tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.168302 Jun 21 10:52:53.044365 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 555/1135] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:52 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:52:54.065397 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:54.066313 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:54.075559 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:54.076136 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:54.077097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:54.077643 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:54.217490 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:54.229185 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:54.231062 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:54.232542 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-964dfdc3-35bf-4d0b-9466-672bdf60c23e tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1724 microversion: 2.20 time: 0.172508 Jun 21 10:52:54.233228 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 581/1136] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:54 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:52:55.255762 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:55.256498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:55.270008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:55.270008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:55.270008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:55.270008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:55.340862 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:55.349918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:55.351498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a75b9c7a5bc4959b27d5c5b87b9c1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136181b906064188b6d06ca200fb9037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:52:55.352816 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a641c37f-63f3-46f6-995b-d1029987e965 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 200 len: 1656 microversion: 2.20 time: 0.101982 Jun 21 10:52:55.353430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 556/1137] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:55 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 1656 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 10:52:55.567783 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-2f280f99-0082-4734-98f8-814cb4f2111a req-bec3b9f1-e3c5-4219-9b71-22cf488016fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea93c513-a1b4-4033-a9eb-31e22a4ff766", "name": "network-vif-deleted", "tag": "59798380-ca6c-4541-ae61-65d365c78611"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:52:55.579699 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2f280f99-0082-4734-98f8-814cb4f2111a req-bec3b9f1-e3c5-4219-9b71-22cf488016fe service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:55.581281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-2f280f99-0082-4734-98f8-814cb4f2111a req-bec3b9f1-e3c5-4219-9b71-22cf488016fe service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:55.603409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-2f280f99-0082-4734-98f8-814cb4f2111a req-bec3b9f1-e3c5-4219-9b71-22cf488016fe service nova] Creating event network-vif-deleted:59798380-ca6c-4541-ae61-65d365c78611 for instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 on hv-cinder-83697 Jun 21 10:52:55.609697 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-2f280f99-0082-4734-98f8-814cb4f2111a req-bec3b9f1-e3c5-4219-9b71-22cf488016fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045666 Jun 21 10:52:55.610441 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 582/1138] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:52:56.371589 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:56.372201 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:56.379466 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:56.379922 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:56.380758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:56.381296 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:56.398328 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 HTTP/1.1 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:52:56.400417 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:56.402197 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'ea93c513-a1b4-4033-a9eb-31e22a4ff766'} Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:56.403139 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:56.404806 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:56.406337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:56.406337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7e464218-9647-48dc-96a7-2d9098e59405 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 404 len: 111 microversion: 2.20 time: 0.034387 Jun 21 10:52:56.406337 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 557/1139] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:56 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:52:56.412530 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3306b97c-196b-450a-b107-38675b80ee79 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '.version_select at 0x7f8a38649940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:56.434021 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3306b97c-196b-450a-b107-38675b80ee79 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875104143" status: 204 len: 0 microversion: 2.20 time: 0.025947 Jun 21 10:52:56.434627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 583/1140] 10.222.0.43 () {60 vars in 1261 bytes} [Tue Jun 21 10:52:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875104143 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 10:52:58.220264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:58.221078 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:58.230315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:58.230930 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:58.231726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:58.232342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:58.252674 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 HTTP/1.1 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:52:58.254814 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.256383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'ea93c513-a1b4-4033-a9eb-31e22a4ff766'} Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:58.258093 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.260107 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.261432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:58.261432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e8355be7-aa0b-4f45-a39d-57c2e9ab59cf tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 404 len: 111 microversion: 2.20 time: 0.042187 Jun 21 10:52:58.261432 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 558/1141] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 21 10:52:58 2022] DELETE /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:52:58.265705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:58.266463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: ea93c513-a1b4-4033-a9eb-31e22a4ff766] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:58.273437 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:58.273891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:58.274851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:58.275295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:58.289383 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 HTTP/1.1 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:52:58.291150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.292891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'ea93c513-a1b4-4033-a9eb-31e22a4ff766'} Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:58.293886 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. Jun 21 10:52:58.295276 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:58.296531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance ea93c513-a1b4-4033-a9eb-31e22a4ff766 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:58.296531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-36c822e9-d848-474b-a1a8-21c0eb59c50d tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766" status: 404 len: 111 microversion: 2.20 time: 0.031441 Jun 21 10:52:58.296531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 584/1142] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:58 2022] GET /compute/v2.1/servers/ea93c513-a1b4-4033-a9eb-31e22a4ff766 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:52:59.440237 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:59.440763 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:59.448535 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:59.448983 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:59.449733 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:59.450188 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:59.465398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f HTTP/1.1 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:52:59.467065 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.468940 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '21bd820c-b0da-4004-abbc-216348f04c3f'} Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:59.469809 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.471487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.473283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:59.473283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-d8650832-3098-4437-8839-817e0b16d9b2 tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 404 len: 111 microversion: 2.20 time: 0.032361 Jun 21 10:52:59.473283 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 559/1143] 10.222.0.43 () {60 vars in 1279 bytes} [Tue Jun 21 10:52:59 2022] DELETE /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:52:59.478157 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:52:59.478770 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] [instance: 21bd820c-b0da-4004-abbc-216348f04c3f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:52:59.486146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:59.486658 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:59.487451 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:52:59.487891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:52:59.502456 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] HTTP exception thrown: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Request method failure captured: Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f HTTP/1.1 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaEn8l_zbg63r7q81AODxfsRVNlCKTovBjtYdGrsIIyVj3i9EcEhnGaL18d-PMSr09H8lNA0dv_yDv3dXT2we2uBAGYi2xHdC8PyK7FbRKuTs-XMh8df2WtIiicdJ93QGmDgHi7lLf_H4q7eC2Wge8HlKgZjMBaTNRBauqorltUBa34 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:52:59.504007 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_136181b906064188b6d06ca200fb9037", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/136181b906064188b6d06ca200fb9037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/136181b906064188b6d06ca200fb9037"}]}] Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 136181b906064188b6d06ca200fb9037 Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-331679291 Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 6a75b9c7a5bc4959b27d5c5b87b9c1cd Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeShelveTestJSON-331679291-project Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.505771 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '21bd820c-b0da-4004-abbc-216348f04c3f'} Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:52:59.506960 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. Jun 21 10:52:59.508501 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:52:59.509854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] Returning 404 to user: Instance 21bd820c-b0da-4004-abbc-216348f04c3f could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:52:59.509854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ed83d0c0-9a89-4815-ad9a-dea5ee2a4cec tempest-AttachVolumeShelveTestJSON-331679291 tempest-AttachVolumeShelveTestJSON-331679291-project] 10.222.0.43 "GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f" status: 404 len: 111 microversion: 2.20 time: 0.031319 Jun 21 10:52:59.509854 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 585/1144] 10.222.0.43 () {60 vars in 1276 bytes} [Tue Jun 21 10:52:59 2022] GET /compute/v2.1/servers/21bd820c-b0da-4004-abbc-216348f04c3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:53:05.504633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-64faff99-d089-4a9e-b0d3-c5bf88c7a5c7 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a367deaf0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:05.554247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-64faff99-d089-4a9e-b0d3-c5bf88c7a5c7 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0eda6c8d-c016-4cef-b40f-909f69b7e56d" status: 200 len: 351 microversion: 2.1 time: 0.053385 Jun 21 10:53:05.554813 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 560/1145] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:53:05 2022] GET /compute/v2.1/os-volumes/0eda6c8d-c016-4cef-b40f-909f69b7e56d => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:06.907781 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-af60d33f-0112-479e-a985-c30d4762f1a4 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a35d89af0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:06.958984 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-af60d33f-0112-479e-a985-c30d4762f1a4 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/56079f73-45ab-4070-816e-ee38cbdc1318" status: 200 len: 350 microversion: 2.1 time: 0.054921 Jun 21 10:53:06.959532 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 586/1146] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:53:06 2022] GET /compute/v2.1/os-volumes/56079f73-45ab-4070-816e-ee38cbdc1318 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:08.352294 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-32d76733-b4dd-4109-bc4f-2089f21a55c4 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a36833af0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.407046 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-32d76733-b4dd-4109-bc4f-2089f21a55c4 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c2c3a301-d39f-4d6c-8363-c1abe3953b50" status: 200 len: 350 microversion: 2.1 time: 0.059109 Jun 21 10:53:08.407607 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 561/1147] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes/c2c3a301-d39f-4d6c-8363-c1abe3953b50 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:08.419749 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3bd50712-301d-46ce-9eca-3fdaea2ce1f3 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a35ca4940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.506372 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3bd50712-301d-46ce-9eca-3fdaea2ce1f3 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090642 Jun 21 10:53:08.507111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 587/1148] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:53:08.519558 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2e75f79c-c911-43e3-9d86-5274910adf12 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a367fd550>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.612304 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2e75f79c-c911-43e3-9d86-5274910adf12 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096454 Jun 21 10:53:08.612871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 562/1149] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:53:08.626516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-a5b67351-5b76-4fb5-9fb8-1671cbf41a84 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a38649940>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.708742 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-a5b67351-5b76-4fb5-9fb8-1671cbf41a84 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086665 Jun 21 10:53:08.709659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 588/1150] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:53:08.721777 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-04b7e3ad-9ba1-4748-841f-554cd0ff5bb7 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a3686e4c0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.804588 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-04b7e3ad-9ba1-4748-841f-554cd0ff5bb7 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086567 Jun 21 10:53:08.805164 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 563/1151] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:08.820533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7f74c25a-f429-422c-9f5d-eb9c90e4ce9b tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a35f99310>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:08.904116 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7f74c25a-f429-422c-9f5d-eb9c90e4ce9b tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090096 Jun 21 10:53:08.904688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 589/1152] 10.222.0.43 () {58 vars in 1169 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:08.919562 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-dea427fc-2f90-415c-a5e5-85c35eeea35b tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a36ab68b0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:09.007331 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-dea427fc-2f90-415c-a5e5-85c35eeea35b tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093842 Jun 21 10:53:09.007907 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 564/1153] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jun 21 10:53:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:53:09.020910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5ef8b2f6-e9e1-49fe-9a87-5274e91c1db6 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a35ca4dc0>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:09.115986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5ef8b2f6-e9e1-49fe-9a87-5274e91c1db6 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098467 Jun 21 10:53:09.116615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 590/1154] 10.222.0.43 () {58 vars in 1187 bytes} [Tue Jun 21 10:53:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:53:09.130186 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3fd6b3fc-efb9-4a32-bfc5-7dfa01396576 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] Calling method '.version_select at 0x7f8a368893a0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:53:09.211352 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3fd6b3fc-efb9-4a32-bfc5-7dfa01396576 tempest-VolumesTestJSON-588119665 tempest-VolumesTestJSON-588119665-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084917 Jun 21 10:53:09.211914 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 565/1155] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jun 21 10:53:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:54:00.182045 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:00.183068 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:00.186870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:00.187367 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:00.196255 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:00.196695 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:00.197455 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:00.197879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:00.223455 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fc3f5703-e429-439a-aa18-28f0e6f46699 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/ips" status: 200 len: 150 microversion: 2.1 time: 0.042838 Jun 21 10:54:00.224029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 591/1156] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:54:00 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:54:01.557395 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=11 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:01.558314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=23 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:01.562871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2e9f03e-861f-4a99-b811-358a64a8bc0b"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:54:01.563945 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:01.571495 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:01.572000 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:01.572702 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:01.573128 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:01.841752 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3f656534-07cd-44cc-9a30-ddc27a773634 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "POST /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285415 Jun 21 10:54:01.842567 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 566/1157] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:54:01 2022] POST /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:54:09.513150 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:09.513756 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:09.521087 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:09.521702 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:09.522508 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:09.522942 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:09.609373 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lazy-loading 'services' on Instance uuid 03f9caca-98a3-4301-a148-e3ac30f3ac5d {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:54:09.687089 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-2454abdd-35d3-4938-b256-8edcdee9e8a4 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments/c2e9f03e-861f-4a99-b811-358a64a8bc0b" status: 202 len: 0 microversion: 2.1 time: 0.177803 Jun 21 10:54:09.687675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 592/1158] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:54:09 2022] DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments/c2e9f03e-861f-4a99-b811-358a64a8bc0b => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:54:09.698136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:09.699154 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:09.706542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:09.707060 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:09.708584 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:09.708960 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:09.741758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a62fe6cc-0870-4c8d-9a92-5c9febd971e1 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048339 Jun 21 10:54:09.742410 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 567/1159] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:54:09 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:54:10.755630 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:10.756505 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:10.763394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:10.763844 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:10.764619 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:10.765053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:10.795101 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-9641822d-c612-4361-b67b-8a160e62d7be tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044699 Jun 21 10:54:10.795660 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 593/1160] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:54:10 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:54:10.856221 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:10.856791 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:10.865917 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:10.866404 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:10.867236 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:10.867670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:10.893564 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:54:10.979308 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f52a73b0-9307-4c0b-9a41-ccb2c59ff61a tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 204 len: 0 microversion: 2.1 time: 0.129685 Jun 21 10:54:10.979985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 568/1161] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:54:10 2022] DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:54:10.990966 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:10.991874 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:10.998394 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:10.998849 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:10.999626 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:11.000088 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:11.143419 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:54:11.151282 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-b9371ca7-8e60-42ee-ae65-975ca7812efe tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1682 microversion: 2.1 time: 0.166796 Jun 21 10:54:11.151969 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 594/1162] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:10 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:54:12.169984 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:12.170722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:12.178680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:12.179842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:12.180736 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:12.181491 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:12.332880 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:54:12.342463 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-a5a03363-16a1-46f4-912c-2485ee8c9354 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1682 microversion: 2.1 time: 0.176918 Jun 21 10:54:12.343044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 569/1163] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:12 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:54:13.366303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:13.366878 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:13.374567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:13.375092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:13.375870 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:13.376295 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:13.516499 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6173a38d9234fb383c0ba017e459372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:54:13.525242 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-bf4786da-791e-4bb9-b9a6-442fd1f1b18f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 200 len: 1682 microversion: 2.1 time: 0.162889 Jun 21 10:54:13.525853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 595/1164] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:13 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:54:13.816913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-069f291d-d5da-48ed-ab47-226e64689995 req-2e1408eb-3034-4baf-a0af-8e7536e47ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f9caca-98a3-4301-a148-e3ac30f3ac5d", "name": "network-vif-deleted", "tag": "9d2a0156-f682-4870-8585-5b82ce851f4b"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:54:13.829213 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-069f291d-d5da-48ed-ab47-226e64689995 req-2e1408eb-3034-4baf-a0af-8e7536e47ea1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:13.829642 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-069f291d-d5da-48ed-ab47-226e64689995 req-2e1408eb-3034-4baf-a0af-8e7536e47ea1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:13.844015 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-069f291d-d5da-48ed-ab47-226e64689995 req-2e1408eb-3034-4baf-a0af-8e7536e47ea1 service nova] Creating event network-vif-deleted:9d2a0156-f682-4870-8585-5b82ce851f4b for instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d on hv-cinder-83697 Jun 21 10:54:13.850936 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-069f291d-d5da-48ed-ab47-226e64689995 req-2e1408eb-3034-4baf-a0af-8e7536e47ea1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038903 Jun 21 10:54:13.852031 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 570/1165] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:54:14.543599 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:14.544259 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:14.551075 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:14.551547 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:14.552289 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:14.552704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:14.566553 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d HTTP/1.1 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:14.568141 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:14.570401 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '03f9caca-98a3-4301-a148-e3ac30f3ac5d'} Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:14.571305 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:14.572725 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:14.573999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:14.573999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e3d8d7b4-2919-4b3e-ba9e-a18fb98cf9da tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.030009 Jun 21 10:54:14.573999 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 596/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:14 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:14.579660 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ec80099f-e064-4c8a-b483-4d2985a0b489 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '.version_select at 0x7f8a3674f0d0>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:14.599476 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ec80099f-e064-4c8a-b483-4d2985a0b489 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744435879" status: 202 len: 0 microversion: 2.1 time: 0.023934 Jun 21 10:54:14.600268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 571/1167] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jun 21 10:54:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744435879 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 10:54:16.419675 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:16.420248 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:16.427374 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:16.427825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:16.428583 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:16.429012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:16.445281 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d HTTP/1.1 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:16.446941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.448421 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '03f9caca-98a3-4301-a148-e3ac30f3ac5d'} Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:16.449222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.450862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.452387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:16.452387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-eeb90e61-378b-4d24-990c-7985a035f918 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.032612 Jun 21 10:54:16.452387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 597/1168] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:54:16 2022] DELETE /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:16.457645 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:16.458585 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 03f9caca-98a3-4301-a148-e3ac30f3ac5d] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:16.467315 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:16.468075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:16.468988 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:16.469467 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:16.484324 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d HTTP/1.1 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:16.486008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.487765 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '03f9caca-98a3-4301-a148-e3ac30f3ac5d'} Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:16.488842 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. Jun 21 10:54:16.490654 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:16.492288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 03f9caca-98a3-4301-a148-e3ac30f3ac5d could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:16.492288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-47e836d2-d1f1-4031-a90f-50baded35ef0 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.034038 Jun 21 10:54:16.492288 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 572/1169] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:16 2022] GET /compute/v2.1/servers/03f9caca-98a3-4301-a148-e3ac30f3ac5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:17.646027 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:17.646596 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:17.653392 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.653861 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.654640 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.655060 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.670496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 HTTP/1.1 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:17.672064 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.674502 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '1a47d1d4-e588-456d-87a2-ba448d805f92'} Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:17.675629 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.677283 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.678909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:17.678909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5c85b072-acfb-428d-99e6-56fe06ce5f56 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 404 len: 111 microversion: 2.1 time: 0.031394 Jun 21 10:54:17.678909 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 598/1170] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:54:17 2022] DELETE /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:17.682426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:17.683019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 1a47d1d4-e588-456d-87a2-ba448d805f92] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:17.690020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.690557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.691262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.691693 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.706232 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 HTTP/1.1 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:17.707789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.709548 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '1a47d1d4-e588-456d-87a2-ba448d805f92'} Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:17.710487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. Jun 21 10:54:17.712847 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.714338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 1a47d1d4-e588-456d-87a2-ba448d805f92 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:17.714338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-105fdad3-5cf4-495f-a56f-6c79e9046d89 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92" status: 404 len: 111 microversion: 2.1 time: 0.030999 Jun 21 10:54:17.714338 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 573/1171] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:17 2022] GET /compute/v2.1/servers/1a47d1d4-e588-456d-87a2-ba448d805f92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:17.718169 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:17.718667 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:17.725009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.725453 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.726236 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.726801 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.740611 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f HTTP/1.1 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:17.742359 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.744167 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'beb7b0dd-9905-4ca1-8a75-cad097411c7f'} Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:17.745154 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.746738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.748303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:17.748303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8a050ad0-3def-46d9-a163-11355ea7b8d2 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 404 len: 111 microversion: 2.1 time: 0.029603 Jun 21 10:54:17.748303 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 599/1172] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:54:17 2022] DELETE /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:17.752606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:17.753372 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: beb7b0dd-9905-4ca1-8a75-cad097411c7f] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:17.762435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.762875 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.763629 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:17.764052 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:17.777754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f HTTP/1.1 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:17.779321 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.781254 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'beb7b0dd-9905-4ca1-8a75-cad097411c7f'} Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:17.782211 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. Jun 21 10:54:17.783780 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:17.785166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance beb7b0dd-9905-4ca1-8a75-cad097411c7f could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:17.785166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9b3e44bd-38c1-4277-8ba4-fa2943143c4b tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f" status: 404 len: 111 microversion: 2.1 time: 0.031960 Jun 21 10:54:17.785166 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 574/1173] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:17 2022] GET /compute/v2.1/servers/beb7b0dd-9905-4ca1-8a75-cad097411c7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:18.922836 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:18.923390 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:18.930656 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:18.931109 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:18.931880 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:18.932310 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:18.947220 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e HTTP/1.1 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:18.948788 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.950480 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '0b6413e8-d55e-46f6-a18a-e3c5a528735e'} Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:18.951379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.952954 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.954802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:18.954802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-de91ff38-9c9d-47ff-9421-a5c8c1e66f7f tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 404 len: 111 microversion: 2.1 time: 0.031359 Jun 21 10:54:18.954802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 600/1174] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:54:18 2022] DELETE /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:54:18.961170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:18.961838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] [instance: 0b6413e8-d55e-46f6-a18a-e3c5a528735e] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:54:18.970251 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:18.970698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:18.971450 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:54:18.971900 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:54:18.985958 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] HTTP exception thrown: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Request method failure captured: Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e HTTP/1.1 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaGYXgJOSGvJFxsrha0tZf7f-UqTbILUWRi7-OyFrbB2QPD2Hd1tm74YPBi9nzAJYhPc71E_ypGK8j-gN6yso_51TnoTdEBo1Je7qY1fszXkPNk6KIL884O20K0R1gOjLPaNe47NSige26j8GgTpMyM8s4UuHX0u-UuvUCSoCKSSEAo Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:18.987553 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5c45b12dc0ce4d0a86fcc176c0cf3d67", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5c45b12dc0ce4d0a86fcc176c0cf3d67"}]}] Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: 5c45b12dc0ce4d0a86fcc176c0cf3d67 Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2042215263 Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: b6173a38d9234fb383c0ba017e459372 Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-AttachVolumeNegativeTest-2042215263-project Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.989350 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '0b6413e8-d55e-46f6-a18a-e3c5a528735e'} Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:18.990383 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. Jun 21 10:54:18.992112 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:18.993680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] Returning 404 to user: Instance 0b6413e8-d55e-46f6-a18a-e3c5a528735e could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:18.993680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-6269fbec-5d6b-459a-a08f-e7dc0b619495 tempest-AttachVolumeNegativeTest-2042215263 tempest-AttachVolumeNegativeTest-2042215263-project] 10.222.0.43 "GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e" status: 404 len: 111 microversion: 2.1 time: 0.033828 Jun 21 10:54:18.993680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 575/1175] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:54:18 2022] GET /compute/v2.1/servers/0b6413e8-d55e-46f6-a18a-e3c5a528735e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:54:23.839637 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-65c900ac-8b22-487a-a2da-0619188ac55e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Action: 'create', calling method: .version_select at 0x7f8a360949d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1059276379", "metadata": {"Type": "work"}}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-65c900ac-8b22-487a-a2da-0619188ac55e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 122 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:23.877143 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1059276379", "metadata": {"Type": "work"}}} Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:54:23.878971 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1059276379', 'metadata': {'Type': 'work'}}}} Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:23.880234 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:54:23.882066 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:54:23.883688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 10:54:23.883688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.883688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-65c900ac-8b22-487a-a2da-0619188ac55e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:23.883688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-65c900ac-8b22-487a-a2da-0619188ac55e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.188669 Jun 21 10:54:23.883688 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 601/1176] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 21 10:54:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:54:23.889310 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9bc693dc-a3af-4cca-b343-05c974e36773 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Action: 'create', calling method: .version_select at 0x7f8a36889820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-423472350", "metadata": {"Type": "work"}}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9bc693dc-a3af-4cca-b343-05c974e36773 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 119 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:23.892594 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-423472350", "metadata": {"Type": "work"}}} Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: Jun 21 10:54:23.894393 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-423472350', 'metadata': {'Type': 'work'}}}} Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi '0' Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:23.895719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:54:23.897953 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:54:23.899812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 10:54:23.899812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.899812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9bc693dc-a3af-4cca-b343-05c974e36773 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:23.899812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9bc693dc-a3af-4cca-b343-05c974e36773 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008783 Jun 21 10:54:23.899812 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 576/1177] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 21 10:54:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:54:23.905312 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96338be9-678b-4c70-8499-bae4795aee0e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Action: 'create', calling method: .version_select at 0x7f8a35ddb550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-491932668", "metadata": {"Type": "work"}}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96338be9-678b-4c70-8499-bae4795aee0e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 118 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:23.908692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-491932668", "metadata": {"Type": "work"}}} Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:54:23.910464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-491932668', 'metadata': {'Type': 'work'}}}} Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise error Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi '' Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:23.911657 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 10:54:23.913420 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 10:54:23.915318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 10:54:23.915318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.915318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-96338be9-678b-4c70-8499-bae4795aee0e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:23.915318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-96338be9-678b-4c70-8499-bae4795aee0e tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009529 Jun 21 10:54:23.915318 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 602/1178] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jun 21 10:54:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 10:54:23.920695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e595b009-55e9-4e7b-b931-23ba4949e93c tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Calling method '.version_select at 0x7f8a36753700>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:23.950862 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-e595b009-55e9-4e7b-b931-23ba4949e93c tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] HTTP exception thrown: Volume tempest-invalid-259825056 could not be found. Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e595b009-55e9-4e7b-b931-23ba4949e93c tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-259825056 HTTP/1.1 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:23.952874 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Volume tempest-invalid-259825056 could not be found. Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': 'tempest-invalid-259825056'} Jun 21 10:54:23.954664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-259825056 could not be found. (HTTP 404) (Request-ID: req-f24dd6f4-7a60-4e8a-ad84-1f39d07186d4) Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.955707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:54:23.957262 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-259825056 could not be found. Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:23.958849 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-259825056 could not be found. Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-259825056 could not be found. Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e595b009-55e9-4e7b-b931-23ba4949e93c tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 404 to user: Volume tempest-invalid-259825056 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e595b009-55e9-4e7b-b931-23ba4949e93c tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-259825056" status: 404 len: 98 microversion: 2.1 time: 0.038366 Jun 21 10:54:23.960435 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 577/1179] 10.222.0.43 () {58 vars in 1214 bytes} [Tue Jun 21 10:54:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-259825056 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 10:54:23.965323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f0eb4af3-9979-4080-ad65-ecbd523fbe4d tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003900 Jun 21 10:54:23.965825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 603/1180] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jun 21 10:54:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 10:54:23.977475 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-fa3b81fa-4ee0-498e-9fea-9416ecdceb7d tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005954 Jun 21 10:54:23.978135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 578/1181] 10.222.0.43 () {58 vars in 1136 bytes} [Tue Jun 21 10:54:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 21 10:54:23.986891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9355820-ddce-4e4a-ac4e-3d7276843730 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Calling method '.version_select at 0x7f8a35d89c10>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:24.016302 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-c9355820-ddce-4e4a-ac4e-3d7276843730 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] HTTP exception thrown: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9355820-ddce-4e4a-ac4e-3d7276843730 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: DELETE /compute/v2.1/os-volumes/6eb33bb3-d388-4c8d-8e22-d9942d18f683 HTTP/1.1 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:54:24.018285 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': '6eb33bb3-d388-4c8d-8e22-d9942d18f683'} Jun 21 10:54:24.020841 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. (HTTP 404) (Request-ID: req-ad84df9f-a21c-40a7-81e5-d4cd167ab17a) Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.022549 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 10:54:24.024862 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 10:54:24.028953 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-c9355820-ddce-4e4a-ac4e-3d7276843730 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 404 to user: Volume 6eb33bb3-d388-4c8d-8e22-d9942d18f683 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-c9355820-ddce-4e4a-ac4e-3d7276843730 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/6eb33bb3-d388-4c8d-8e22-d9942d18f683" status: 404 len: 109 microversion: 2.1 time: 0.036423 Jun 21 10:54:24.031447 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 604/1182] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jun 21 10:54:23 2022] DELETE /compute/v2.1/os-volumes/6eb33bb3-d388-4c8d-8e22-d9942d18f683 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 10:54:24.033147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b77dda7-2c83-45ce-8fdb-583e5b0f9e44 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Calling method '.version_select at 0x7f8a36889820>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:54:24.062431 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-3b77dda7-2c83-45ce-8fdb-583e5b0f9e44 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] HTTP exception thrown: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b77dda7-2c83-45ce-8fdb-583e5b0f9e44 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Request method failure captured: Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: GET /compute/v2.1/os-volumes/1c406afa-8e06-46a7-a5a0-639fa97b1388 HTTP/1.1 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaNfNZ1xuqqCTNknHpSXsgj4aK_m_QGr8QRJNU1vXo-hawEv1B8IbnD-7BJzbLDKu8s8PTVUv6VC2s-Ep_IWxQXKmWja4qVOlyAJ1mW4miW6kEAcFuGfdtjSwUTaf5w0BW1KQ-DPOkUWba2irVlordZJma6_daD4fxcVpQiWFN7CPJw Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:54:24.068028 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e503ffcf364e4767a1335f12a9437a27", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e503ffcf364e4767a1335f12a9437a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e503ffcf364e4767a1335f12a9437a27"}]}] Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: e503ffcf364e4767a1335f12a9437a27 Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-VolumesNegativeTest-252282097 Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 7ae069ecc4e24494a07f7b3f30795461 Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-VolumesNegativeTest-252282097-project Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'id': '1c406afa-8e06-46a7-a5a0-639fa97b1388'} Jun 21 10:54:24.070640 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. (HTTP 404) (Request-ID: req-8a44a64a-d294-4e7c-a79d-8db173646ad3) Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.071670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 10:54:24.073209 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 10:54:24.074634 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3b77dda7-2c83-45ce-8fdb-583e5b0f9e44 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] Returning 404 to user: Volume 1c406afa-8e06-46a7-a5a0-639fa97b1388 could not be found. {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3b77dda7-2c83-45ce-8fdb-583e5b0f9e44 tempest-VolumesNegativeTest-252282097 tempest-VolumesNegativeTest-252282097-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1c406afa-8e06-46a7-a5a0-639fa97b1388" status: 404 len: 109 microversion: 2.1 time: 0.043895 Jun 21 10:54:24.076044 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 579/1183] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jun 21 10:54:24 2022] GET /compute/v2.1/os-volumes/1c406afa-8e06-46a7-a5a0-639fa97b1388 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:55:10.246356 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=20 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:10.247109 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:10.251070 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'create', calling method: .version_select at 0x7f8a360949d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-574170903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlCAmz7UMJplFIrF0RyqK+RPiHZee76SZgPSEWtXRd0aUj33HY2GiVI9bclVlxWUDEv7baoQ9mPlgAQbEtYziTmsDpmCx/2baWxyI5wNiKW2/GahpIRxxyvRUBGHfxNEQ=="}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:10.267709 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Getting quotas for project b0144da9d9c2404ba08c90e551b1e5c8. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:55:10.271910 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.quota [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Getting quotas for user 26196017350a47ac8633f6741a277006 and project b0144da9d9c2404ba08c90e551b1e5c8. Resources: {'key_pairs'} {{(pid=124179) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:55:10.284131 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [65ac043b-77b4-404b-83f2-22381b21b68a] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:55:11.292662 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [65ac043b-77b4-404b-83f2-22381b21b68a] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54628. Jun 21 10:55:11.312409 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6734ba94-3fdb-46cc-a163-e97a2c922657 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.067496 Jun 21 10:55:11.313023 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 605/1184] 10.222.0.43 () {60 vars in 1158 bytes} [Tue Jun 21 10:55:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:11.363838 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:11.364579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:11.369923 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1069259751", "imageRef": "7171a4d3-9524-4667-8647-b34020b12eb7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-574170903", "networks": [{"uuid": "91e0696e-316c-4a70-a229-cd9bc1c2df10"}]}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:11.423364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.network.neutron [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] validate_networks() for [('91e0696e-316c-4a70-a229-cd9bc1c2df10', None, None, None, None, None)] {{(pid=124180) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 10:55:11.946670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Flavor limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 10:55:11.947086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Image limits 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 10:55:11.947560 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Flavor pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 10:55:11.947968 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Image pref 0:0:0 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 10:55:11.948375 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.virt.hardware [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 10:55:11.958333 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:11.959608 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:11.959608 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:11.959992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:11.981784 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Getting quotas for project b0144da9d9c2404ba08c90e551b1e5c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 10:55:11.986397 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.quota [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Getting quotas for user 26196017350a47ac8633f6741a277006 and project b0144da9d9c2404ba08c90e551b1e5c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124180) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 10:55:11.999429 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Going to run 1 instances... {{(pid=124180) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 10:55:12.001071 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7171a4d3-9524-4667-8647-b34020b12eb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 10:55:12.049174 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-b0937f40-2040-4e41-839a-d17ddb871998 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686855 Jun 21 10:55:12.049830 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 580/1185] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jun 21 10:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 10:55:12.060175 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e2c1cc3a-8026-4357-b378-9bb91454c989 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:12.060793 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e2c1cc3a-8026-4357-b378-9bb91454c989 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:12.121270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e2c1cc3a-8026-4357-b378-9bb91454c989 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:12.129029 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e2c1cc3a-8026-4357-b378-9bb91454c989 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1258 microversion: 2.1 time: 0.072775 Jun 21 10:55:12.129802 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 606/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:12 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:13.147610 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:13.148256 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:13.155041 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:13.155485 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:13.156268 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:13.156679 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:13.236344 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:13.244977 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-18d5276e-630b-48a9-850e-fe67bd63f0e0 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1310 microversion: 2.1 time: 0.102090 Jun 21 10:55:13.245911 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 581/1187] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:13 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:14.262705 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:14.263495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:14.270452 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:14.271179 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:14.271957 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:14.272618 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:14.432873 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:14.442026 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-3f90cb0c-a781-4ceb-ad4c-50727ae6c3e3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.183028 Jun 21 10:55:14.442691 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 607/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:14 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:15.462016 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:15.463628 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:15.471293 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:15.471703 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:15.472877 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:15.473439 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:15.637470 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:15.652503 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-cf23cd34-cf53-4eb0-89c6-3d4f2b5851da tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.195598 Jun 21 10:55:15.653719 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 582/1189] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:15 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:16.671181 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:16.671986 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:16.679907 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:16.680349 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:16.681115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:16.681577 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:16.828738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:16.838146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-57252c39-490a-4a46-9b06-db466fe6ab83 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.170653 Jun 21 10:55:16.839222 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 608/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:16 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:17.856215 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:17.856989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:17.864141 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:17.864642 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:17.865388 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:17.866276 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:18.024430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:18.031971 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-c7e703ef-8af8-4597-9580-9a3d2e1d7556 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.179872 Jun 21 10:55:18.032543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 583/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:17 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:19.049980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:19.050785 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:19.057739 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:19.058244 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:19.059026 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:19.059465 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:19.222979 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:19.232199 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f1eda563-fe56-4d9b-b57d-6adebba8f327 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.186090 Jun 21 10:55:19.234097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 609/1192] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:19 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:20.249882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:20.250552 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:20.258786 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:20.259223 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:20.260030 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:20.260478 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:20.413320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:20.421148 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2a1b41d2-85e1-4879-84a7-979a72ad91d8 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.175429 Jun 21 10:55:20.421712 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 584/1193] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:20 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:21.439201 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:21.439838 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:21.447009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:21.447464 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:21.448251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:21.448690 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:21.591835 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:21.602627 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-54be4d15-47a8-4f53-bc30-516344e3368c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.167545 Jun 21 10:55:21.603205 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 610/1194] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:21 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:22.621317 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:22.622266 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:22.626760 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=2 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:22.627707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell0:SELECT=6 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:22.632024 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:22.632728 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:22.633574 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:22.634001 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:22.777423 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:22.788334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-23f08b7e-aa79-4afd-86b5-db53d8cad1f5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.171338 Jun 21 10:55:22.789156 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 585/1195] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:22 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:23.805746 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:23.806425 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:23.808335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=6 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:23.815457 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:23.815895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:23.824335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:23.824335 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:23.955427 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:23.972214 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-abc06d34-ad09-43eb-9030-e8cb4523e47c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.171080 Jun 21 10:55:23.972815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 611/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:23 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:24.180396 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-cae6b787-6141-459f-86f3-d48eb23328a8 req-e540d13e-09ea-4d42-8248-9a354096c1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:24.188879 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-cae6b787-6141-459f-86f3-d48eb23328a8 req-e540d13e-09ea-4d42-8248-9a354096c1d6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:24.189348 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-cae6b787-6141-459f-86f3-d48eb23328a8 req-e540d13e-09ea-4d42-8248-9a354096c1d6 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:24.205343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-cae6b787-6141-459f-86f3-d48eb23328a8 req-e540d13e-09ea-4d42-8248-9a354096c1d6 service nova] Creating event network-changed:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:55:24.210541 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-cae6b787-6141-459f-86f3-d48eb23328a8 req-e540d13e-09ea-4d42-8248-9a354096c1d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034920 Jun 21 10:55:24.214726 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 586/1197] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:24.992344 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:24.992939 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:25.000069 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:25.000518 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:25.001286 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:25.001724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:25.139931 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:25.147686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e369bb1a-b058-40ee-91ab-5abea1112667 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.161075 Jun 21 10:55:25.148330 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 612/1198] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:24 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:26.168443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:26.169207 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:26.178076 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:26.178758 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:26.180134 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:26.180774 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:26.333990 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:26.343136 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-9ede84fb-4019-46d0-974c-34411f27e100 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.181041 Jun 21 10:55:26.343706 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 587/1199] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:26 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:27.361554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:27.362191 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:27.370186 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:27.370752 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:27.371588 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:27.372098 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:27.514431 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:27.522270 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7462ff2c-9e4f-4e72-a13c-d76f8a965a33 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.164968 Jun 21 10:55:27.522927 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 613/1200] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:27 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:28.542494 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:28.543075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:28.549320 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:28.549754 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:28.550519 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:28.551184 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:28.693742 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:28.701967 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-f67ca995-d8b5-4891-8c69-3e825436b65e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.164204 Jun 21 10:55:28.702568 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 588/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:28 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:29.725914 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:29.726847 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:29.733887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:29.734379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:29.735145 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:29.735586 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:29.878413 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:29.891146 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-5373559f-dea4-4aaf-b5cb-5073c39cfcce tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.171143 Jun 21 10:55:29.892053 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 614/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:29 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:30.909615 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:30.910383 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:30.917306 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:30.917727 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:30.918576 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:30.919005 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:31.024738 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-e731ebd3-a4ce-4d6d-9de0-433a5e62c6ce req-351cfe42-72ac-4525-9dcc-9f755c5dcf17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "name": "network-vif-plugged", "status": "completed", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:31.032992 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-e731ebd3-a4ce-4d6d-9de0-433a5e62c6ce req-351cfe42-72ac-4525-9dcc-9f755c5dcf17 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:31.033430 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-e731ebd3-a4ce-4d6d-9de0-433a5e62c6ce req-351cfe42-72ac-4525-9dcc-9f755c5dcf17 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:31.044989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-e731ebd3-a4ce-4d6d-9de0-433a5e62c6ce req-351cfe42-72ac-4525-9dcc-9f755c5dcf17 service nova] Creating event network-vif-plugged:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:55:31.050019 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-e731ebd3-a4ce-4d6d-9de0-433a5e62c6ce req-351cfe42-72ac-4525-9dcc-9f755c5dcf17 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165393 Jun 21 10:55:31.050632 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 589/1203] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:31.058216 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:31.069824 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f10b1317-2708-4f3f-9ea2-1a98da334693 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.164537 Jun 21 10:55:31.070664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 615/1204] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:30 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:32.089522 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:32.090295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:32.098105 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:32.098666 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:32.099529 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:32.100040 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:32.259008 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:32.267896 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-79a45c0b-b917-4687-874c-f63a25505dde tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1358 microversion: 2.1 time: 0.183470 Jun 21 10:55:32.268454 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 590/1205] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:32 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:33.288614 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:33.289261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:33.297112 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.297567 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.298369 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.298806 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.491362 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:33.499278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-f50bfd2b-5cc2-4894-af4b-3574bcacf3dd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1549 microversion: 2.1 time: 0.216972 Jun 21 10:55:33.499883 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 616/1206] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:33 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:33.515999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:33.516681 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:33.523326 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.523677 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.524623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.525599 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.666750 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:33.679498 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ff68b10c-c59f-4d2c-86ae-88a354c82e8d tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1549 microversion: 2.1 time: 0.167062 Jun 21 10:55:33.680391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 591/1207] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:33 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:33.698895 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:33.703686 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:33.704500 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Searching by: {'deleted': False, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8'} {{(pid=124179) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 10:55:33.714022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.714484 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.715269 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.715694 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.808190 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.multi_cell_list [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124179) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 10:55:33.901096 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-ced1de1c-37d5-4f0a-8aa3-bbf3d3f5b331 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207817 Jun 21 10:55:33.901905 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 617/1208] 10.222.0.43 () {58 vars in 1124 bytes} [Tue Jun 21 10:55:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:33.915248 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:33.915882 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:33.922097 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.922554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:33.923302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:33.923722 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:34.068480 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:34.077334 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-36b4ef07-d55d-4e58-ae99-c358c492f760 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1549 microversion: 2.1 time: 0.165937 Jun 21 10:55:34.077910 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 592/1209] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:33 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:35.619807 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "810f856a-f364-4468-bd89-3f4dd17329d0"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:35.620887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:35.627692 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:35.628139 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:35.628930 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:35.629371 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:35.908028 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-77cf432a-70f5-4c73-8b5b-b293f87080fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291668 Jun 21 10:55:35.908851 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 618/1210] 10.222.0.43 () {60 vars in 1322 bytes} [Tue Jun 21 10:55:35 2022] POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:43.497999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:43.498680 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:43.501222 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:43.507487 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:43.508004 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:43.508781 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:43.509187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:43.512258 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=67 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:43.692967 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:43.703613 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-e1af54d1-ac6f-4dc2-87a1-d4bb894ac322 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1595 microversion: 2.1 time: 0.209896 Jun 21 10:55:43.704187 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 593/1211] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:43 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1595 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:45.709446 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-5d92a190-38bf-4972-9e72-ab8d488bb92c req-ea9b22d8-4621-4064-acb0-d2c677562aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:45.718415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell0:SELECT=2 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:45.718415 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:45.721117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5d92a190-38bf-4972-9e72-ab8d488bb92c req-ea9b22d8-4621-4064-acb0-d2c677562aaf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:45.721117 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-5d92a190-38bf-4972-9e72-ab8d488bb92c req-ea9b22d8-4621-4064-acb0-d2c677562aaf service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:45.733009 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:45.735541 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-5d92a190-38bf-4972-9e72-ab8d488bb92c req-ea9b22d8-4621-4064-acb0-d2c677562aaf service nova] Creating event network-changed:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:55:45.740815 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-5d92a190-38bf-4972-9e72-ab8d488bb92c req-ea9b22d8-4621-4064-acb0-d2c677562aaf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035479 Jun 21 10:55:45.741418 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 619/1212] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:55:46.708711 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1962379016"}} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:46.709246 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:46.715850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:46.716482 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:46.717231 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:46.717655 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:46.861723 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.network.security_group_api [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Adding security group 7ab95325-0edc-46d1-901e-efb529305d7a to port 28576f4c-efaf-4f21-a7aa-330bd2a3e492 Jun 21 10:55:47.217897 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-460b1cd8-47f8-43d5-aef8-952df0e0ce77 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action" status: 202 len: 0 microversion: 2.1 time: 0.513157 Jun 21 10:55:47.218526 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 594/1213] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:55:46 2022] POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:55:47.229659 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:55:47.230610 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:55:47.243155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:47.243624 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:47.244431 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:47.245475 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:47.413271 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:55:47.423941 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-8a101e55-5d2c-4b2b-8c74-06c459b587fd tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1761 microversion: 2.1 time: 0.199813 Jun 21 10:55:47.424538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 620/1214] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:55:47 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1761 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:55:47.757989 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-563b433e-afe6-4bd5-b492-d1263b3b0f9d req-fcd6ce3f-244f-4658-93f5-5973ec5bce25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:55:47.766906 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-563b433e-afe6-4bd5-b492-d1263b3b0f9d req-fcd6ce3f-244f-4658-93f5-5973ec5bce25 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:55:47.767356 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-563b433e-afe6-4bd5-b492-d1263b3b0f9d req-fcd6ce3f-244f-4658-93f5-5973ec5bce25 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:55:47.779359 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-563b433e-afe6-4bd5-b492-d1263b3b0f9d req-fcd6ce3f-244f-4658-93f5-5973ec5bce25 service nova] Creating event network-changed:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:55:47.784549 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-563b433e-afe6-4bd5-b492-d1263b3b0f9d req-fcd6ce3f-244f-4658-93f5-5973ec5bce25 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030740 Jun 21 10:55:47.785593 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 595/1215] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:56:47.872379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=4 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:56:47.874092 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=7 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:56:47.882035 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:56:47.883622 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:47.892817 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:47.893304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:47.894063 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:47.894513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:47.970533 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-38677a0c-b91a-40c8-935e-e2d4c999fab4 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action" status: 202 len: 0 microversion: 2.1 time: 0.100831 Jun 21 10:56:47.971155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 621/1216] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:56:47 2022] POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:56:47.983167 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:47.983911 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:47.986006 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=5 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:56:47.986715 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=11 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:56:47.992789 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:47.993264 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:47.994177 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:47.994746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:48.194633 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:48.203301 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0c656ebe-ff1b-4dd3-a51d-ee6ff66b11f2 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1753 microversion: 2.1 time: 0.225742 Jun 21 10:56:48.203884 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 596/1217] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:47 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:49.226019 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:49.227208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:49.238982 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:49.239723 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:49.241022 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:49.241724 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:49.394111 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:49.407126 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-fddf4526-6152-49c0-8084-e5c69bb17c52 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.188041 Jun 21 10:56:49.407926 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 622/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:49 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:50.434746 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:50.435905 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:50.442999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:50.443798 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:50.444557 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:50.444985 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:50.606122 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:50.619407 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-7fe154d3-1817-4bf8-be6f-a15410542958 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.190890 Jun 21 10:56:50.620153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 597/1219] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:50 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:51.640790 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:51.641582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:51.649531 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:51.650094 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:51.650997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:51.651513 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:51.806399 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:51.816516 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-35de33d3-990d-41ea-9bd1-d533d4ca5523 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.181571 Jun 21 10:56:51.817103 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 623/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:51 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:52.839191 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:52.840143 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:52.848175 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:52.848623 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:52.849389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:52.849827 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:53.008327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:53.017269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-8f19caa7-326d-41bf-a377-6e467edb96b6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.185143 Jun 21 10:56:53.017836 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 598/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:52 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:54.039388 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:54.040008 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:54.048676 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:54.048676 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:54.049014 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:54.049432 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:54.194813 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:54.203253 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-99d546e6-fc60-44c6-ae32-fab055827f4c tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.167826 Jun 21 10:56:54.204115 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 624/1222] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:54 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:55.220020 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:55.220631 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:55.229465 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:55.229913 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:55.230708 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:55.231135 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:55.380389 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:55.391958 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-4237d795-dfae-49c3-a436-c0767aa152d3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.175984 Jun 21 10:56:55.392532 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 599/1223] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:55 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:56.413681 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:56.414704 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:56.426107 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:56.426875 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:56.428235 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:56.428958 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:56.589012 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:56.598278 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-d96a4cfe-c6e8-4f00-b8c6-822e8e914652 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.191035 Jun 21 10:56:56.598850 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 625/1224] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:56 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:57.622342 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:57.623343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:57.633652 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:57.634455 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:57.635704 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:57.636433 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:57.789543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:57.801364 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-2950bdcb-e854-4e26-9214-544f3caebce3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.185799 Jun 21 10:56:57.801937 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 600/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:57 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:56:58.823487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:56:58.824448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:56:58.835738 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:58.836492 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:58.838110 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:56:58.838891 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:56:59.007825 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:56:59.019261 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-6da5bdbc-dd67-4d28-aeb6-5ffc7c03f85a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1758 microversion: 2.1 time: 0.202834 Jun 21 10:56:59.019832 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 626/1226] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:56:58 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:57:00.041075 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:57:00.042147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:57:00.051695 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:57:00.052147 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:57:00.052922 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:57:00.053360 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:57:00.204412 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:57:00.217314 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-504665ed-ed44-468d-bd35-75998283982e tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1761 microversion: 2.1 time: 0.182638 Jun 21 10:57:00.218249 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 601/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:57:00 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1761 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:57:27.268542 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:57:27.269740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Tue Jun 21 10:57:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:57:30.412753 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 10:57:30.413623 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Tue Jun 21 10:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 10:58:03.368097 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_api:SELECT=12 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:03.371786 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG dbcounter [-] [124179] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:03.381995 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1962379016"}} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:58:03.382887 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:03.396013 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:03.396463 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:03.397251 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:03.397682 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:03.539831 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.network.security_group_api [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Removing security group 7ab95325-0edc-46d1-901e-efb529305d7a from port 28576f4c-efaf-4f21-a7aa-330bd2a3e492 Jun 21 10:58:03.952536 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-aa76f33c-62c7-4489-aace-a0bb5a711e70 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action" status: 202 len: 0 microversion: 2.1 time: 0.587547 Jun 21 10:58:03.953538 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 627/1228] 10.222.0.43 () {60 vars in 1277 bytes} [Tue Jun 21 10:58:03 2022] POST /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:58:03.962343 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_api:SELECT=12 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:03.963319 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG dbcounter [-] [124180] Writing DB stats nova_cell1:SELECT=36 {{(pid=124180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:04.116802 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:58:04.124991 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:04.125841 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:04.139313 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] Creating event network-changed:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:58:04.143521 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR oslo.messaging._drivers.impl_rabbit [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] [5eb4b2b7-803c-44b4-aa20-b89e610b56aa] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 10:58:05.041387 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:05.041966 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:05.048049 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:05.048495 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:05.049323 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:05.050453 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:05.134664 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.objects.instance [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lazy-loading 'services' on Instance uuid a1b0a883-a86c-4944-b9f5-5215e29c6316 {{(pid=124179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 10:58:05.151881 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] [5eb4b2b7-803c-44b4-aa20-b89e610b56aa] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54900. Jun 21 10:58:05.159391 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-7ed9749a-bf43-4e7b-9dc8-955aed5153bd req-07995717-0d32-4a35-8199-b186306dd274 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.198282 Jun 21 10:58:05.160243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 602/1229] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:58:05.214570 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-7be56f1c-65cd-4574-bb53-1effee096f6a tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments/810f856a-f364-4468-bd89-3f4dd17329d0" status: 202 len: 0 microversion: 2.1 time: 0.177258 Jun 21 10:58:05.215196 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 628/1230] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:58:05 2022] DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments/810f856a-f364-4468-bd89-3f4dd17329d0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 10:58:05.224362 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:05.225377 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:05.231855 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:05.232285 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:05.233269 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:05.233717 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:05.265670 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-3193bb40-bee7-48a0-902d-5321b463fc06 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Jun 21 10:58:05.266974 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 603/1231] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:58:05 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:58:06.278571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:06.279638 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:06.287448 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:06.287882 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:06.288669 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:06.289130 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:06.321710 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-1f7db8c8-56be-41d4-85c4-780dfbabf7b3 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047898 Jun 21 10:58:06.322539 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 629/1232] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jun 21 10:58:06 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 10:58:06.332559 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:06.333153 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:06.339707 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:06.340239 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:06.340999 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:06.341426 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:06.423543 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.wsgi [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] HTTP exception thrown: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 is not attached to volume 810f856a-f364-4468-bd89-3f4dd17329d0 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Request method failure captured: Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: request: DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments/810f856a-f364-4468-bd89-3f4dd17329d0 HTTP/1.1 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept: application/json Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Accept-Encoding: identity Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Connection: close Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Length: 0 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Content-Type: application/json Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Host: 10.222.0.43 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Openstack-System-Scope: None Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: User-Agent: python-urllib3/1.26.9 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Auth-Token: gAAAAABisaOAir5cr8hgsGyWhyaxgRcKRt7V-fj1AqTuZW8Es2THAw0SqExlbVoFll93TnKj_qtDUMGycF_rVfpAt6yLHXNkS7tUDAmoF4lIT4mpGr_Mffm_RN4QCKNe-U16f7wV9Gj-6JA_nqoMDe5EwtVF-dMRI3g1Zw9AfrGvoIZnhzXnQ3E Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Id: None Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Domain-Name: None Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Identity-Status: Confirmed Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Is-Admin-Project: True Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Id: default Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Domain-Name: Default Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Id: b0144da9d9c2404ba08c90e551b1e5c8 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Project-Name: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Role: member,reader Jun 21 10:58:06.426247 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Roles: member,reader Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0144da9d9c2404ba08c90e551b1e5c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0144da9d9c2404ba08c90e551b1e5c8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0144da9d9c2404ba08c90e551b1e5c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0144da9d9c2404ba08c90e551b1e5c8"}]}] Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Id: b0144da9d9c2404ba08c90e551b1e5c8 Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User: tempest-TestMinimumBasicScenario-1820727108-project Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Id: default Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Domain-Name: Default Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Id: 26196017350a47ac8633f6741a277006 Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: X-User-Name: tempest-TestMinimumBasicScenario-1820727108-project Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: method: > Jun 21 10:58:06.428170 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: exception: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 is not attached to volume 810f856a-f364-4468-bd89-3f4dd17329d0 Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: action_args: {'server_id': 'a1b0a883-a86c-4944-b9f5-5215e29c6316', 'id': '810f856a-f364-4468-bd89-3f4dd17329d0'} Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 810f856a-f364-4468-bd89-3f4dd17329d0. Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:58:06.429295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 is not attached to volume 810f856a-f364-4468-bd89-3f4dd17329d0 Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 is not attached to volume 810f856a-f364-4468-bd89-3f4dd17329d0 Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: ERROR nova.api.openstack.wsgi Jun 21 10:58:06.430773 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Returning 404 to user: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 is not attached to volume 810f856a-f364-4468-bd89-3f4dd17329d0 {{(pid=124180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:58:06.432086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0868b60c-6a34-477a-a836-afabd71382a5 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments/810f856a-f364-4468-bd89-3f4dd17329d0" status: 404 len: 154 microversion: 2.1 time: 0.099305 Jun 21 10:58:06.432086 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 604/1233] 10.222.0.43 () {58 vars in 1415 bytes} [Tue Jun 21 10:58:06 2022] DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316/os-volume_attachments/810f856a-f364-4468-bd89-3f4dd17329d0 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:58:07.173582 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [req-047314e5-2a6e-421c-9df6-767a74272859 req-9ee3e11f-0611-44c6-857c-085b974be210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:58:07.182571 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-047314e5-2a6e-421c-9df6-767a74272859 req-9ee3e11f-0611-44c6-857c-085b974be210 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:07.183002 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [req-047314e5-2a6e-421c-9df6-767a74272859 req-9ee3e11f-0611-44c6-857c-085b974be210 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:07.195445 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.compute.server_external_events [req-047314e5-2a6e-421c-9df6-767a74272859 req-9ee3e11f-0611-44c6-857c-085b974be210 service nova] Creating event network-changed:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:58:07.200428 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [req-047314e5-2a6e-421c-9df6-767a74272859 req-9ee3e11f-0611-44c6-857c-085b974be210 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 Jun 21 10:58:07.200997 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 630/1234] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 10:58:07.569302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:07.569871 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:07.576302 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:07.576740 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:07.577490 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:07.577915 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:07.603757 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Going to try to terminate instance {{(pid=124180) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 10:58:07.684243 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-ca6bebdf-b32c-4f68-b5a0-b9a4a7530350 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 204 len: 0 microversion: 2.1 time: 0.119355 Jun 21 10:58:07.684918 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 605/1235] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jun 21 10:58:07 2022] DELETE /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 10:58:07.694975 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:07.695840 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:07.702496 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:07.702951 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:07.703717 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:07.704155 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:07.839208 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:58:07.847252 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-e0d597cf-e787-4150-8f6c-ed5041c9f04b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1555 microversion: 2.1 time: 0.157725 Jun 21 10:58:07.847855 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 631/1236] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:58:07 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:58:08.870398 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:08.871512 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.compute.api [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124180) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:08.881845 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:08.882327 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:08.883108 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:08.883525 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:09.031554 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.policy [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124180) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:58:09.039500 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-1cbc0d4d-a329-460a-9df3-82a78fe46f4b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1555 microversion: 2.1 time: 0.176739 Jun 21 10:58:09.040073 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 606/1237] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:58:08 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:58:10.057554 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:10.058980 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:10.071212 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:10.073034 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:10.074853 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:10.075487 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:10.152964 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.policy [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26196017350a47ac8633f6741a277006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0144da9d9c2404ba08c90e551b1e5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124179) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 10:58:10.163822 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-80966905-93db-4011-970e-bc8c7d1fc6f6 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 200 len: 1513 microversion: 2.1 time: 0.110550 Jun 21 10:58:10.164386 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 632/1238] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:58:10 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 1513 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 10:58:10.180443 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [req-8153b57e-3803-4f0c-a28e-2f9587382642 req-eae4b32b-162a-4b7f-8b6b-377532071cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b0a883-a86c-4944-b9f5-5215e29c6316", "name": "network-vif-deleted", "tag": "28576f4c-efaf-4f21-a7aa-330bd2a3e492"}]} {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 10:58:10.188664 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-8153b57e-3803-4f0c-a28e-2f9587382642 req-eae4b32b-162a-4b7f-8b6b-377532071cd1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:10.189111 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG oslo_concurrency.lockutils [req-8153b57e-3803-4f0c-a28e-2f9587382642 req-eae4b32b-162a-4b7f-8b6b-377532071cd1 service nova] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:10.201698 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.compute.server_external_events [req-8153b57e-3803-4f0c-a28e-2f9587382642 req-eae4b32b-162a-4b7f-8b6b-377532071cd1 service nova] Creating event network-vif-deleted:28576f4c-efaf-4f21-a7aa-330bd2a3e492 for instance a1b0a883-a86c-4944-b9f5-5215e29c6316 on hv-cinder-83697 Jun 21 10:58:10.206579 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [req-8153b57e-3803-4f0c-a28e-2f9587382642 req-eae4b32b-162a-4b7f-8b6b-377532071cd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109663 Jun 21 10:58:10.207371 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 607/1239] 10.222.0.43 () {64 vars in 1317 bytes} [Tue Jun 21 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 10:58:11.181879 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '>' {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:11.182580 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.compute.api [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] [instance: a1b0a883-a86c-4944-b9f5-5215e29c6316] Fetching instance by UUID {{(pid=124179) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 10:58:11.190466 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:11.190968 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:11.191839 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 10:58:11.192591 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG oslo_concurrency.lockutils [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Lock "002ebcf0-7789-424b-b18d-3bf9b98012a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 10:58:11.206881 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.wsgi [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] HTTP exception thrown: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Request method failure captured: Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: request: GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 HTTP/1.1 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept: application/json Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Accept-Encoding: identity Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Connection: close Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Length: 0 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Content-Type: application/json Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Host: 10.222.0.43 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Openstack-System-Scope: None Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: User-Agent: python-urllib3/1.26.9 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Auth-Token: gAAAAABisaOAir5cr8hgsGyWhyaxgRcKRt7V-fj1AqTuZW8Es2THAw0SqExlbVoFll93TnKj_qtDUMGycF_rVfpAt6yLHXNkS7tUDAmoF4lIT4mpGr_Mffm_RN4QCKNe-U16f7wV9Gj-6JA_nqoMDe5EwtVF-dMRI3g1Zw9AfrGvoIZnhzXnQ3E Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Id: None Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Domain-Name: None Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Identity-Status: Confirmed Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Is-Admin-Project: True Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Id: default Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Domain-Name: Default Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Id: b0144da9d9c2404ba08c90e551b1e5c8 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Project-Name: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Role: member,reader Jun 21 10:58:11.208529 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Roles: member,reader Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0144da9d9c2404ba08c90e551b1e5c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b0144da9d9c2404ba08c90e551b1e5c8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b0144da9d9c2404ba08c90e551b1e5c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b0144da9d9c2404ba08c90e551b1e5c8"}]}] Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Id: b0144da9d9c2404ba08c90e551b1e5c8 Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1820727108 Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User: tempest-TestMinimumBasicScenario-1820727108-project Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Id: default Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Domain-Name: Default Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Id: 26196017350a47ac8633f6741a277006 Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: X-User-Name: tempest-TestMinimumBasicScenario-1820727108-project Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: method: > Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: exception: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. Jun 21 10:58:11.210379 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: action_args: {'id': 'a1b0a883-a86c-4944-b9f5-5215e29c6316'} Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: {{(pid=124179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 10:58:11.211290 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. Jun 21 10:58:11.212718 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: ERROR nova.api.openstack.wsgi Jun 21 10:58:11.214095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: DEBUG nova.api.openstack.wsgi [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Returning 404 to user: Instance a1b0a883-a86c-4944-b9f5-5215e29c6316 could not be found. {{(pid=124179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 10:58:11.214095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO nova.api.openstack.requestlog [None req-dc0ca63e-6af5-459a-81d9-5965f819549b tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jun 21 10:58:11.214095 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: [pid: 124179|app: 0|req: 633/1240] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jun 21 10:58:11 2022] GET /compute/v2.1/servers/a1b0a883-a86c-4944-b9f5-5215e29c6316 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 10:58:11.220158 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: DEBUG nova.api.openstack.wsgi [None req-0afc0dda-efb4-468f-baf2-867e37679f88 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] Calling method '.version_select at 0x7f8a36a08a60>' {{(pid=124180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 10:58:11.240295 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO nova.api.openstack.requestlog [None req-0afc0dda-efb4-468f-baf2-867e37679f88 tempest-TestMinimumBasicScenario-1820727108 tempest-TestMinimumBasicScenario-1820727108-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-574170903" status: 202 len: 0 microversion: 2.1 time: 0.024769 Jun 21 10:58:11.240850 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: [pid: 124180|app: 0|req: 608/1241] 10.222.0.43 () {58 vars in 1268 bytes} [Tue Jun 21 10:58:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-574170903 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 11:00:40.265696 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:00:40.266706 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Tue Jun 21 11:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 11:00:47.282466 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:00:47.283368 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Tue Jun 21 11:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 11:00:50.426304 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:00:50.427204 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Tue Jun 21 11:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 11:00:59.299901 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:00:59.300831 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Tue Jun 21 11:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 11:01:06.166472 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:01:06.166976 dv-cinder-836973-8-iscsi devstack@n-api.service[124179]: Tue Jun 21 11:01:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 11:03:30.672606 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 11:03:30.673263 dv-cinder-836973-8-iscsi devstack@n-api.service[124180]: Tue Jun 21 11:03:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!